Broadcast reception device and video display method

ABSTRACT

A broadcast reception device receives a digital broadcast service capable of executing an application cooperating with a broadcast program, and is provided with: a broadcast reception unit which receives broadcast waves of the digital broadcast service; a separation unit which separates video information relating to the broadcast program and application-related information from the received broadcast waves; a broadcast video decoding unit which decodes the video information relating to the broadcast program; an application acquisition unit which acquires an application on the basis of location information included in the application-related information; an application execution unit which executes the acquired application and acquires additional data from a server device; a video conversion unit which converts broadcast program video decoded by the broadcast decoding unit into high-quality video having a higher quality than the video using the acquired additional data; and a display unit which is able to display the high-quality video.

INCORPORATION BY REFERENCE

The present application is a continuation of U.S. patent applicationSer. No. 16/396,390, filed Apr. 26, 2019, which is continuation of U.S.patent application Ser. No. 15/108,245, filed Jun. 24, 2016, now U.S.Pat. No. 10,321,186, which is the U.S. National Phase under 35 U.S.C. §371 of International Application No. PCT/JP2014/080663, filed Nov. 19,2014, which claims priority to Japanese Patent Application No.2013-270912, filed on Dec. 27, 2013, the entire contents of each arehereby incorporated by reference.

TECHNICAL FIELD

The present invention relates to a broadcast receiving technology.

BACKGROUND ART

Data broadcasting is one of extended functions of a digital broadcastservice, which sends digital data by way of a broadcast wave to displayweather forecast or news, and various pieces of information such as arecommended program. A number of televisions capable of receiving databroadcasting have been available, and a number of technologies relatingto receiving the data broadcasting, including Patent Literature 1, havebeen published.

CITATION LIST Patent Literature

-   PATENT LITERATURE 1: JP-A 2001-186486 DM US 181839250-1.062807.0844

SUMMARY OF INVENTION Technical Problem

Examples of characteristics of the data broadcasting include that atelevision adapted to a digital broadcast service can receive the databroadcasting by itself alone to acquire/display a variety of pieces ofinformation. On the other hand, the data broadcasting is limited in asendable data volume by a radio wave band limitation, which makes itdifficult to obtain high-definition screen displaying and highfunctional effects, and therefore, it has been disadvantageouslydifficult to execute higher-value added useful functions by a currentdigital broadcasting receiver.

An object of the present invention is to provide a digital broadcastingreceiver capable of executing a higher-value added function.

Solution to Problem

An example of means for solving the problem may include a broadcastreceiving device receiving a digital broadcast service which is capableof executing an application in cooperation with a broadcast program,comprising a broadcast receiving unit that receives a broadcast wave ofthe digital broadcast service, a separation unit that separates at leastvideo information of a broadcast program and application-relatedinformation from the received broadcast wave, a broadcast video decodingunit that decodes the video information of the broadcast program, anapplication acquisition unit that acquires a predetermined applicationon the basis of location information acquired by referring to theapplication-related information, an application execution unit thatexecutes the acquired predetermined application to acquire additionaldata from a predetermined server device, a video conversion unit thatconverts the broadcast program video decoded by the broadcast videodecoding unit into a high-quality video having a higher quality picturethan the former video by use of the additional data acquired by theapplication execution unit, and a display unit capable of displaying thehigh-quality video.

Advantageous Effects of Invention

According to the present invention, a digital broadcasting technologycapable of executing a higher-value added function can be provided.

Other objects, features, and advantages of the present invention may beapparent from descriptions of embodiments according to the presentinvention relating to the attached drawings.

BRIEF DESCRIPTION OF DRAWINGS

FIG. 1 is a system configuration diagram of a communication systemaccording to an embodiment.

FIG. 2A is a block diagram of a broadcast receiving device according toan embodiment.

FIG. 2B is a software configuration diagram of the broadcast receivingdevice according to an embodiment.

FIG. 3 is a block diagram of a broadcast station server according to anembodiment.

FIG. 4 is a block diagram of a service provider server according to anembodiment.

FIG. 5A is a block diagram of a portable information terminal accordingto an embodiment.

FIG. 5B is a software configuration diagram of the broadcast receivingdevice according to an embodiment.

FIG. 6 is a data configuration diagram of an application informationtable according to an embodiment.

FIG. 7A is an operational sequence diagram of the broadcast receivingdevice in running an application according to an embodiment.

FIG. 7B is an operational sequence diagram of the broadcast receivingdevice in running the application according to an embodiment.

FIG. 7C is an operational sequence diagram of the broadcast receivingdevice in running the application according to an embodiment.

FIG. 8A is an operational sequence diagram in cooperation of a portableinformation terminal according to an embodiment.

FIG. 8B is an operational sequence diagram in cooperation of theportable information terminal according to an embodiment.

FIG. 8C is an operational sequence diagram in cooperation of theportable information terminal according to an embodiment.

FIG. 9 is an operational sequence diagram of the broadcast receivingdevice and the portable information terminal in running an applicationaccording to an embodiment.

FIG. 10A is a screen display illustration of a base screen for acooperation control app of the portable information terminal accordingto an embodiment.

FIG. 10B is a screen display illustration of a base screen for thecooperation control app of the portable information terminal accordingto an embodiment.

FIG. 11 is a screen display illustration of a data broadcast screen ofthe broadcast receiving device according to an embodiment.

FIG. 12A is a screen display illustration of an annunciation screen ofthe broadcast receiving device according to an embodiment.

FIG. 12B is a screen display illustration for a broadcast cooperativeapp launcher of the broadcast receiving device according to anembodiment.

FIG. 13A is a screen display illustration of a broadcast cooperative appexecution screen of the broadcast receiving device according to anembodiment.

FIG. 13B is a screen display illustration of the broadcast cooperativeapp execution screen of the broadcast receiving device according to anembodiment.

FIG. 13C is a screen display illustration of the broadcast cooperativeapp execution screen of the broadcast receiving device according to anembodiment.

FIG. 13D is a screen display illustration of the broadcast cooperativeapp execution screen of the broadcast receiving device according to anembodiment.

FIG. 14 is a screen display illustration of an error display screen ofthe broadcast receiving device according to an embodiment.

FIG. 15 is a screen display illustration of a broadcast cooperative appexecution screen of the portable information terminal according to anembodiment.

FIG. 16A is a screen display illustration of an EPG display screen ofthe broadcast receiving device according to an embodiment.

FIG. 16B is an illustration of detailed information in the EPG displayscreen of the broadcast receiving device according to an embodiment.

FIG. 17 is an operational sequence diagram of the broadcast receivingdevice on acquisition of the broadcast cooperative app according to anembodiment.

FIG. 18A is an operational sequence diagram in cooperation of a terminalaccording to an embodiment.

FIG. 18B is an operational sequence diagram in cooperation of theterminal according to an embodiment.

FIG. 18C is an operational sequence diagram in cooperation of theterminal according to an embodiment.

FIG. 18D is an operational sequence diagram in cooperation of theterminal according to an embodiment.

FIG. 19A is a screen display illustration for the broadcast cooperativeapp launcher of the broadcast receiving device according to anembodiment.

FIG. 19B is a screen display illustration for the broadcast cooperativeapp launcher of the broadcast receiving device according to anembodiment.

FIG. 19C is a screen display illustration for the broadcast cooperativeapp launcher of the broadcast receiving device according to anembodiment.

FIG. 19D is a screen display illustration for the broadcast cooperativeapp launcher of the broadcast receiving device according to anembodiment.

FIG. 19E is a screen display illustration of the broadcast receivingdevice according to an embodiment.

FIG. 19F is a screen display illustration for a broadcast cooperativeapp launcher of the portable information terminal according to anembodiment.

FIG. 20A is a block diagram of the broadcast receiving device accordingto an embodiment.

FIG. 20B is a software configuration diagram of the broadcast receivingdevice according to an embodiment.

FIG. 21A is a conceptual diagram of signal processing (on the broadcaststation side) in the communication system according to an embodiment.

FIG. 21B is a conceptual diagram of signal processing (on the broadcastreceiving device side) in the communication system according to anembodiment.

FIG. 22 is an operational sequence diagram of interpolation signalprocessing in the broadcast receiving device according to an embodiment.

FIG. 23A is a conceptual diagram of the signal processing (on thebroadcast station side) in the communication system according to anembodiment.

FIG. 23B is a conceptual diagram of the signal processing (on thebroadcast receiving device side) in the communication system accordingto an embodiment.

FIG. 24 is an operational sequence diagram of the interpolation signalprocessing in the broadcast receiving device according to an embodiment.

FIG. 25A is a conceptual diagram of the signal processing (on thebroadcast station side) in the communication system according to anembodiment.

FIG. 25B is a conceptual diagram of the signal processing (on thebroadcast receiving device side) in the communication system accordingto an embodiment.

FIG. 26A is a conceptual diagram of the signal processing (on thebroadcast station side) in the communication system according to anembodiment.

FIG. 26B is a conceptual diagram of the signal processing (on thebroadcast receiving device side) in the communication system accordingto an embodiment.

FIG. 27 is an operational sequence diagram of the interpolation signalprocessing in the broadcast receiving device according to an embodiment.

FIG. 28 is a screen display illustration of a high-quality picturedisplaying confirmation screen of the broadcast receiving deviceaccording to an embodiment.

DESCRIPTION OF EMBODIMENTS

Hereinafter, a description is given of examples of illustrativeembodiments according to the present invention with reference to thedrawings.

Embodiment 1

First, a description is given of an example of a digital broadcastservice receivable by a broadcast receiving device in the embodiment.

For example, an example of BS/digital terrestrial broadcasting which isreceivable by the broadcast receiving device in the embodiment cantransmit a plurality of transport streams (TS) with being multiplexed onone transponder (frequency channel). The TS includes continuous packetseach having a predetermined length in which a data row such as avideo/audio Elementary Stream (ES) and program specific information(PSI)/service information (SI) is divided and a TS header is added.

The PSI, which is defined by MPEG (moving picture experts group)-2system standard, is a specific information table for identifying whichprogram each ES included in the TS belongs to. The PSI includes a PAT(program association table), a PMT (program map table), and a CAT(conditional access table). The PAT defines a program list included inthe TS using a PID (packet identifier) of the PMT. The PMT defines thePID for a component of each program and the like. The CAT includesinformation regarding a conditional access.

Moreover, the SI, which has the PSI extended and includes programinformation, includes information regarding an electronic program guide(EPG) defined by Association of Radio Industries and Businesses (ARIB)with ARIB STD-B10. The SI includes a BIT (broadcaster informationtable), an SDT (service description table), an EIT (event informationtable), and a TOT (time offset table). The BIT includes broadcaststation identification information, affiliation information, and SIsending information of the broadcast station. The SDT includesinformation such as a network ID for identifying a network, a TS ID foridentifying a TS, and a service ID (so-called channel number) foridentifying each service (so-called channel) within the network. The EITincludes a service ID for identifying each service within the network,and information regarding an event such as a name, broadcast date andtime, and broadcast content of each event (so-called program). The TOTincludes information regarding a current date and a current time.

In addition, the TS includes a PCR (program clock reference) informationas a reference for a reproducing timing in a decoder, and a BML documentmade into a subset on the basis of a BML (broadcast markup language)specification defined by ARIB STD-B24.

The broadcast receiving device in the embodiment can receive and decodethe TS constituted by the video/audio ES, various pieces of informationand the like to provide a data broadcast screen and the like producedusing the broadcast program or the EPG and the BML to a user.

Moreover, the broadcast receiving device in the embodiment can beadapted to a broadcast communication cooperation system in which thedigital broadcast service is made to cooperate with a function to use abroadband network and the digital broadcast service is combined withacquisition of additional content via the broadband network, arithmeticprocessing in a server device, presentation processing by way ofcooperation with a portable terminal device, and the like. In order toachieve the broadcast communication cooperation system, the broadcastreceiving device in the embodiment may be able to execute an applicationwritten by HTML (Hyper Text Markup Language) or the like. Further, thebroadcast communication cooperation system to which this broadcastreceiving device may be adapted uses an extended BML specification,application control information (application information table: AIT) inthe broadcast communication cooperation system, and extended PSI/SIinformation needed when an application is transmitted by way of abroadcast wave. Note that the AIT is the information for providing ornotifying various pieces of information needed to run an applicationsuch as about a site for acquiring the application, and controlinformation for controlling run/end of the application and the like.

The above description is based on the digital broadcast service inJapan, but whose application is not limited to those in Japan only,including the broadcast communication cooperation system to which thebroadcast receiving device in the embodiment is adapted.

Next, a description is given of a concrete configuration example of theillustrative embodiment in the embodiment.

[System Configuration]

FIG. 1 is a system configuration diagram showing an example of acommunication system for achieving the broadcast communicationcooperation system in the embodiment. The communication system in theembodiment includes a broadcast receiving device 100 and an antenna 100a, a broadband network 200 such as the Internet and a router device 210,a radio tower 300 t of a broadcast station, a broadcast station server300, a service provider server 400, other application servers 500, amobile telephone communication server 600 and a base station 600 b of amobile telephone communication network, and a portable informationterminal 700.

The broadcast receiving device 100 is a television having a functioncorresponding to the broadcast communication cooperation system inaddition to an existing digital broadcasting receiving function. Thebroadcast receiving device 100 receives via the antenna 100 a thebroadcast wave sent out from the radio tower 300 t. The broadcastreceiving device 100 can also connect with the Internet 200 via therouter device 210, and send and receive data by way of communicationwith respective server devices on the Internet 200.

The router device 210 is connected with the Internet 200 by way ofwireless communication or wired communication, with the broadcastreceiving device 100 by way of the wireless communication or the wiredcommunication, and with the portable information terminal 700 by way ofthe wireless communication. This may allow the respective server deviceson the Internet 200, the broadcast receiving device 100, the portableinformation terminal 700 to mutually send and receive the data via therouter device 210. Note that the broadcast receiving device 100 and theportable information terminal 700 may directly communicate with eachother using a scheme such as BlueTooth (registered trademark), NFC (nearfield communication) or the like without via the router device 210.

The radio tower 300 t sends out the broadcast wave including digitalbroadcast signals, the AIT, and the control information regardingapplication presentation from a broadcast facility of the broadcaststation. Note that the control information regarding the applicationpresentation refers to the control information regarding superimpositionof the broadcast program and the application on the television, andwhether or not the application is presented. Moreover, the broadcaststation may include the broadcast station server 300. The broadcaststation server 300 may be able to store the broadcast program (movingpicture content or the like) and metadata of each broadcast program suchas a program title, a program ID, a program overview, cast members, andbroadcast air date and time, and provide the moving picture content andeach piece of the metadata to a service provider on the basis of acontract. Note that the provision of the moving picture content and eachpiece of the metadata to the service provider may be made through an API(application programming interface) included in the broadcast stationserver 300.

The service provider server 400 is a server device prepared by theservice provider for providing a service owing to the broadcastcommunication cooperation system. The service provider server 400stores, manages and delivers the moving picture content and the metadataprovided by the broadcast station server 300, and content andapplication produced for the broadcast communication cooperation system.The service provider server 400 also has a function to searchapplications available to an inquiry from the television and provide alist of the relevant applications. Note that the server deviceperforming storage, management and delivery of the content and themetadata may be different from that performing storage, management anddelivery of the application. The broadcast station and the serviceprovider may be the same provider or may be different providers. Aplurality of the service provider servers 400 may be preparedrespectively for different services. Moreover, the broadcast stationserver 300 may have the function of the service provider server 400 inone.

The other application servers 500 each are a known server device whichstores, manages, and delivers a general application, an operationprogram, content, and data relating to other than the broadcastcommunication cooperation system.

The mobile telephone communication server 600 is connected with theInternet 200, while connected with the portable information terminal 700via the base station 600 b. The mobile telephone communication server600 manages telephone communication (phone call) and datasending/receiving of the portable information terminal 700 via themobile telephone communication network to enable the data to be sent andreceived by way of communication between the portable informationterminal 700 and the respective server devices on the Internet 200. Notethat the communication between the portable information terminal 700 andthe broadcast receiving device 100 may be performed via the base station600 b and the mobile telephone communication server 600, the Internet200, and the router device 210.

[Hardware Configuration of Broadcast Receiving Device]

FIG. 2A is a block diagram showing an example of an internalconfiguration of the broadcast receiving device 100. The broadcastreceiving device 100 includes a main control unit 101, a system bus 102,a ROM 103, a RAM 104, a storage unit 110, a LAN communication unit 121,an expansion interface unit 124, a digital interface unit 125, atuner/demodulation unit 131, a first separation unit 132, a first videodecoding unit 133, a first audio decoding unit 134, a first captiondecoding unit 135, a data broadcast reception processing unit 141, adata broadcast engine 142, a streaming reception processing unit 151, asecond separation unit 152, a second video decoding unit 153, a secondaudio decoding unit 154, a second caption decoding unit 155, anapplication control unit 161, an application engine 162, a videosuperimposition unit 171, an audio selection unit 172, a video displayunit 173, a speaker 174, a video output unit 175, an audio output unit176, a presentation synchronization control unit 181, and a terminalcooperation control unit 191.

The main control unit 101 is a microprocessor unit that generallycontrols the broadcast receiving device 100 in accordance with apredetermined operation program. The system bus 102 is a datacommunication path for performing the data sending/receiving between themain control unit 101 and respective operation blocks in the broadcastreceiving device 100.

The ROM (Read Only Memory) 103 is a memory storing therein a basicoperation program such as an operating system and other operationprograms, for which a rewritable ROM such as an EEPROM (electricallyerasable programmable ROM) or a flash ROM may be used, for example. TheRAM (random access memory) 104 is a work area in executing the basicoperation program or other operation programs. The ROM 103 and the RAM104 may be integrally formed together with the main control unit 101.Moreover, the ROM 103 may not be necessarily formed into an independentconfiguration as shown in FIG. 2A, but may use a partial storage area inthe storage unit 110.

The storage unit 110 stores therein the operation program or operationsetting values for the broadcast receiving device 100, personalinformation of a user of the broadcast receiving device 100, and thelike. In addition, the storage unit 110 may store therein the operationprogram downloaded from over the network, various pieces of data createdby means of the operation program, and the like. Moreover, the storageunit 110 may store therein the content such as a moving picture, a stillimage, and audio which are obtained from the broadcast wave ordownloaded from over the network. A partial area of the storage unit 110may be used instead of all or a part of the functions of the ROM 103.Further, the storage unit 110 is required to maintain the storedinformation, even if the broadcast receiving device 100 is in a state ofbeing not externally supplied with power. Therefore, for example, usedfor the storage unit 110 is a device including a semiconductor devicememory such as a flash ROM or an SSD (solid state drive), and a magneticdisk drive such as an HDD (hard disc drive).

Note that the respective operation programs stored in the ROM 103 or thestorage unit 110 may be able to be updated and extended in functionthrough a download process from the respective server devices on theInternet 200.

The LAN (local area network) communication unit 121 is connected via therouter device 210 with the Internet 200 to send and receive the data toand from the respective server devices on the Internet 200. Theconnection with the router device 210 may be the wired connection or thewireless connection such as the Wi-Fi (registered trademark). The LANcommunication unit 121 may include an encoding circuit and a decodingcircuit. Additionally, the broadcast receiving device 100 may furtherinclude other communication units such as a BlueTooth (registeredtrademark) communication unit, an NFC communication unit, and aninfrared communication unit.

The tuner/demodulation unit 131 receives the broadcast wave via theantenna 100 a from the radio tower 300 t to tune in to (select) achannel for the service desired by the user on the basis of control bythe main control unit 101. Further, the tuner/demodulation unit 131demodulates the received broadcast signal to acquire the TS. Note thatthe example shown in FIG. 2A illustrates the configuration in which onetuner/demodulation unit is included, but the broadcast receiving device100 may be configured to include a plurality of tuner/demodulation unitsfor the purpose of displaying of multiple screens at the same time orvideo-recording of a competing program in the same time slot. Moreover,control of access limitation or the like may be made on the demodulatedTS on the basis of the control by the main control unit 101.

The first separation unit 132 receives the TS output from thetuner/demodulation unit 131, and separates the TS into data rows such asa video data row, an audio data row, a caption data row, a programinformation data row, an AIT data row, and a BML data row to output therows. These data rows may have an ES format, for example. The firstvideo decoding unit 133 decodes the video data row received from thefirst separation unit 132 to output video information. The first audiodecoding unit 134 decodes the audio data row received from the firstseparation unit 132 to output audio information. The first captiondecoding unit 135 decodes the caption data row received from the firstseparation unit 132 to output caption information.

The data broadcast reception processing unit 141 decodes the BML datarow received from the first separation unit 132 to reproduce the BMLdocument. The data broadcast engine 142, which is a BML browser forexecuting the BML document, executes the BML document reproduced by thedata broadcast reception processing unit 141 to output data broadcastscreen information.

The streaming reception processing unit 151 accesses via LANcommunication unit 121 the moving picture content or the like placed oneach server device over the Internet 200 on the basis of the control bythe main control unit 101 to acquire a program stream (PS) of the movingpicture content or the like. In addition, control of DRM (digital rightsmanagement) processing or the like may be made on the acquired PS on thebasis of the control by the main control unit 101.

The second separation unit 152 receives the PS output from the streamingreception processing unit 151, and separates the PS into data rows suchas a video data row, an audio data row, and a caption data row to outputthe rows. These data rows may have an ES format, for example. The secondvideo decoding unit 153, the second audio decoding unit 154, and thesecond caption decoding unit 155 perform the processes respectivelysimilar to the first video decoding unit 133, the first audio decodingunit 134, and the first caption decoding unit 135, and thus,descriptions thereof are omitted.

Note that the respective pairs of the first separation unit 132 and thesecond separation unit 152, the first video decoding unit 133 and thesecond video decoding unit 153, the first audio decoding unit 134 andthe second audio decoding unit 154, and the first caption decoding unit135 and the second caption decoding unit 155 may be combined with eachother.

The application control unit 161 encourages the application engine 162,concerning an application produced for the broadcast communicationcooperation system, in order to control and manage a life cycle and anevent in units of applications on the basis of the AIT data row receivedfrom the first separation unit or an AIT file acquired from each serverdevice over the Internet 200. Additionally, the application control unit161 appropriately makes control of application functional restrictiondepending on a state of the application and an instruction by means ofthe AIT. The application engine 162 is an HTML browser for acquiring andexecuting the application produced for the broadcast communicationcooperation system on the basis of the control by the applicationcontrol unit 161.

The video superimposition unit 171 receives the video information outputfrom the first video decoding unit 133, the caption information outputfrom the first caption decoding unit 135, the data broadcast screeninformation output from the data broadcast engine 142, the videoinformation output from the second video decoding unit 153, the captioninformation output from the second caption decoding unit 155, andapplication execution screen information output from the applicationengine 162 to perform processing of selection and/or superimposition andthe like. The video superimposition unit 171 includes a video RAM notshown in the figure, and the video display unit 173 or the like isdriven on the basis of the video information input to the video RAM.Moreover, the video superimposition unit 171 performs, as needed,scaling processing, superimposition processing for EPG screeninformation created on the basis of the program information data rowwhich is output from the first separation unit 132, and the like on thebasis of the control by the main control unit 101.

The audio selection unit 172 receives the audio information output fromthe first audio decoding unit 134, the audio information output from thesecond audio decoding unit 154, and application execution audioinformation output from the application engine 162 to appropriatelyselect and output the audio information in response to the control bythe main control unit 101.

The video display unit 173, which is, for example, a display device suchas a liquid crystal panel, provides the video information subjected tothe selection and/or superimposition processing by the videosuperimposition unit 171 to the user of the broadcast receiving device100. The speaker 174 provides the audio information output from theaudio selection unit 172 to the user of the broadcast receiving device100. The video output unit 175 is a video output interface foroutputting the video information subjected to the selection and/orsuperimposition processing by the video superimposition unit 171. Theaudio output unit 176 is an audio output interface for outputting theaudio information output from the audio selection unit 172. Note that inthe case where the broadcast receiving device 100 is a television asdescribed above, the video output unit 175 and the audio output unit 176are not necessarily required as the component in the present invention.

The presentation synchronization control unit 181 performs control ofpresentation synchronization among the video information, the audioinformation, and the like obtained by decoding the TS acquired frombroadcast wave, among the video information, the audio information, andthe like obtained by decoding the PS acquired from the respectiveservers over the Internet 200, and among the application executionscreen information and the application execution audio informationoutput from the application engine 162, on the video display unit 173and the speaker 174, or on the video output unit 175 and audio outputunit 176, on the basis of the PCR information or the like.

The terminal cooperation control unit 191 manages and controls, incooperating with an external portable terminal device, discovery andauthentication of a cooperative device (portable terminal device),connection between the broadcast receiving device 100 and thecooperative device, application cooperation, and the like.

The expansion interface unit 124, which is a group of interfaces forextending the function of the broadcast receiving device 100, mayinclude an analog video/audio interface, a USB (universal serial bus)interface, and a memory interface, in the embodiment. The analogvideo/audio interface inputs an analog video signal/audio signal from anexternal video/audio output device, outputs an analog video signal/audiosignal to an external video/audio input device, or the like. The USBinterface is connected with a PC or the like to send and receive thedata. The USB interface may be connected with the HDD to record thebroadcast program or the content. Moreover, the USB interface may beconnected with a keyboard or other USB devices. The memory interface isconnected with a memory card or other memory media to send and receivethe data.

The digital interface unit 125 is an interface for outputting orinputting encoded digital video data and/or digital audio data. Thedigital interface unit 125 may able to output the TS acquired by thetuner/demodulation unit 131 or the PS acquired by the streamingreception processing unit 151 as it is. In addition, the TS or PS inputfrom the digital interface unit 125 may be controlled to be input to thefirst separation unit 132 or the second separation unit 152. Outputtingthe digital content stored in the storage unit 110 or storing thedigital content in the storage unit 110 may be performed through thedigital interface unit 125. The digital interface unit 125 may be a DVIterminal, an HDMI (registered trademark) terminal, or the like throughwhich data output or input is performed in a form compliant with DVIspecification, HDMI (registered trademark) specification or the like.The output or input may be performed in a form of serial data compliantwith the IEEE 1394 specification or the like.

The broadcast receiving device 100 may be, besides the television, anoptical disc drive recorder such as a DVD (digital versatile disc)recorder, a magnetic disk drive recorder such as an HDD recorder, a STB(set top box) and the like. The broadcast receiving device 100 may be aPC (personal computer), a tablet terminal, a game console, or the likeprovided with the digital broadcasting receiving function and abroadcast communication cooperation function. In a case where thebroadcast receiving device 100 is a DVD recorder, a HDD recorder, a STB,or the like, the device 100 may not necessarily include the videodisplay unit 173 and the speaker 174. By connecting an external monitorand an external speaker to the video output unit 175 and the audiooutput unit 176, respectively, an operation similar to the broadcastreceiving device 100 in the embodiment may be enabled.

[Software Configuration of Broadcast Receiving Device]

FIG. 2B is a software configuration diagram of the broadcast receivingdevice 100 in the embodiment, and shows a configuration of software inthe ROM 103, the RAM 104, and the storage unit 110. In the embodiment,stored in the ROM 103 are a basic operation program 1001 and otheroperation programs, and stored in the storage unit 110 are a receivingfunction program 1002, a BML browser program 1003, an HTML browserprogram 1004, and other operation programs. Additionally, the storageunit 110 may include a content storage area 1011 for storing the contentsuch as the moving picture, the still image, and the audio, anauthentication information storage area 1012 for storing authenticationinformation or the like used in cooperating or the like with theexternal portable terminal device, and a various pieces informationstorage area for storing other various pieces of information.

The basic operation program 1001 stored in the ROM 103 is expanded onthe RAM 104, and further, the main control unit 101 executes theexpanded basic operation program such that a basic operation executionunit 1101 is configured. Each of the receiving function program 1002,the BML browser program 1003, and the HTML browser program 1004 whichare stored in the storage unit 110 is expanded on the RAM 104, andfurther, the main control unit 101 executes each expanded operationprogram such that a receiving function execution unit 1102, a BMLbrowser engine 1103, and an HTML browser engine 1104 are configured.Moreover, the RAM 104 may include a transient storage area fortransiently holding, as needed, the data created in executing eachoperation program.

Note that, in the following description for the purpose of simplifyingthe description, a description is given assuming that the process inwhich the main control unit 101 expands the basic operation program 1001stored in the ROM 103 on the RAM 104 and executes it to control therespective operation blocks is a process in which the basic operationexecution unit 1101 controls the respective operation blocks. Otheroperation programs are also described similarly.

The receiving function execution unit 1102 controls the respectiveoperation blocks in the broadcast receiving device 100 in order toattain the broadcasting receiving function and the broadcastcommunication cooperation function. Particularly, a broadcast programreproduction unit 1102 a mainly controls the tuner/demodulation unit131, the first separation unit 132, the first video decoding unit 133,the first audio decoding unit 134, the first caption decoding unit 135,the data broadcast reception processing unit 141, and the data broadcastengine 142. Note that the data broadcast engine 142 may be substitutedby the BML browser engine 1103 expanded on the RAM 104. In addition, acommunication content reproduction unit 1102 b mainly controls thestreaming reception processing unit 151, the second separation unit 152,the second video decoding unit 153, the second audio decoding unit 154,and the second caption decoding unit 155. A cooperative app control unit1102 c mainly controls the application control unit 161 and theapplication engine 162. Note that the application engine 162 may besubstituted by the HTML browser engine 1104 expanded on the RAM 104. Aterminal cooperation management unit 1102 d mainly controls the terminalcooperation control unit 191.

Each operation program may be in a state of being stored in the ROM 103and/or the storage unit 110 in advance at the time of product shipment.The operation program may be those acquired from other applicationservers 500 or the like over the Internet 200 via the LAN communicationunit 121 after product shipment. Moreover, the respective operationprograms stored in the memory card, the optical disc or the like may beacquired via the expansion interface unit 124 and the like.

[Configuration of Broadcast Station Server]

FIG. 3 is a block diagram showing an example of an internalconfiguration of the broadcast station server 300. The broadcast stationserver 300 includes a main control unit 301, a system bus 302, a RAM304, a storage unit 310, and a LAN communication unit 321.

The main control unit 301 is a microprocessor unit that generallycontrols the broadcast station server 300 in accordance with apredetermined operation program. The system bus 302 is a datacommunication path for performing the data sending/receiving between themain control unit 301 and respective operation blocks in the broadcaststation server 300. The RAM 304 is a work area in executing therespective operation programs.

The storage unit 310 stores a basic operation program 3001 and a contentmanagement/delivery program 3002, and further includes a moving picturecontent storage area 3011 and a metadata storage area 3012. The movingpicture content storage area 3011 stores the moving picture content orthe like of each broadcast program broadcasted by the broadcast station.The metadata storage area 3012 stores the metadata of each broadcastprogram such as the program title, the program ID, the program overview,the cast members, and the broadcast air date and time.

The basic operation program 3001 and the content management/deliveryprogram 3002 stored in the storage unit 310 each are expanded on the RAM304, and further, the main control unit 301 executes the expanded basicoperation program and content management/delivery program such that abasic operation execution unit 3101 and a content management/deliveryexecution unit 3102 are configured.

Note that, in the following description for the purpose of simplifyingthe description, a description is given assuming that the process inwhich the main control unit 301 expands the basic operation program 3001stored in the storage unit 310 on the RAM 304 and executes it to controlthe respective operation blocks is a process in which the basicoperation execution unit 3101 controls the respective operation blocks.Other operation programs are also described similarly.

The content management/delivery execution unit 3102 performs themanagement of the moving picture content or the like and each piece ofthe metadata respectively accumulated in the moving picture contentstorage area 3011 and the metadata storage area 3012, and the control inproviding the moving picture content or the like and each piece of themetadata to the service provider on the basis of a contract. Further,the content management/delivery execution unit 3102 also performs, asneeded, an authentication process or the like for the service providerserver 400 on the basis of the contract, in providing the moving picturecontent or the like and each piece of the metadata to the serviceprovider.

The LAN communication unit 321 is connected with the Internet 200 tocommunicate with the service provider server 400 or the like over theInternet 200. The LAN communication unit 321 may include an encodingcircuit and a decoding circuit.

[Configuration of Service Provider Server]

FIG. 4 is a block diagram showing an example of an internalconfiguration of the service provider server 400. The service providerserver 400 includes a main control unit 401, a system bus 402, a RAM404, a storage unit 410, and a LAN communication unit 421.

The main control unit 401 is a microprocessor unit that generallycontrols the service provider server 400 in accordance with apredetermined operation program. The system bus 402 is a datacommunication path for performing the data sending/receiving between themain control unit 401 and respective operation blocks in serviceprovider server 400. The RAM 404 is a work area in executing therespective operation programs.

The storage unit 410 stores a basic operation program 4001, a contentmanagement/delivery program 4002, and an applicationmanagement/distribution program 4003, and further includes a movingpicture content storage area 4011, a metadata storage area 4012, and anapplication storage area 4013. The moving picture content storage area4011 and the metadata storage area 4012 stores the moving picturecontent or the like and each piece of the metadata which are providedfrom the broadcast station server 300, and the content and the metadataor the like regarding the content produced by the service provider. Theapplication storage area 4013 stores an application which is to bedistributed in response to a request from each television and isrequired for attaining each service of the broadcast communicationcooperation system.

The basic operation program 4001, the content management/deliveryprogram 4002, and the application management/distribution program 4003stored in the storage unit 410 each are expanded on the RAM 404, andfurther, the main control unit 401 executes the expanded basic operationprogram, content management/delivery program, and applicationmanagement/distribution program such that a basic operation executionunit 4101, a content management/delivery execution unit 4102, and anapplication management/distribution execution unit 4103 are configured.

Note that, in the following description for the purpose of simplifyingthe description, a description is given assuming that the process inwhich the main control unit 401 expands the basic operation program 4001stored in the storage unit 410 on the RAM 404 and executes it to controlthe respective operation blocks is a process in which the basicoperation execution unit 4101 controls the respective operation blocks.Other operation programs are also described similarly.

The content management/delivery execution unit 4102 controls theacquisition of the moving picture content or the like and each piece ofthe metadata from the broadcast station server 300, the management ofthe moving picture content or the like and each piece of the metadataaccumulated in the moving picture content storage area 4011 and themetadata storage area 4012, and the delivery of the moving picturecontent or the like and each piece of the metadata to each television.The application management/distribution execution unit 4103 performs themanagement of each application accumulated in the application storagearea 4013, and the control in distributing each application in responseto the request from each television. Further, the applicationmanagement/distribution execution unit 4103 also performs, as needed, anauthentication process or the like for each television, in distributingeach application to each television.

The LAN communication unit 421 is connected with the Internet 200 tocommunicate with the broadcast receiving device 100 or the portableinformation terminal 700 via the broadcast station server 300 over theInternet 200 or the router device 210. The LAN communication unit 421may include an encoding circuit and a decoding circuit.

[Hardware Configuration of Portable Information Terminal]

FIG. 5A is a block diagram showing an example of an internalconfiguration of the portable information terminal 700. The portableinformation terminal 700 includes a main control unit 701, a system bus702, a ROM 703, a RAM 704, a storage unit 710, a communicationprocessing unit 720, an expansion interface unit 724, an operation unit730, an image processing unit 740, an audio processing unit 750, and asensor unit 760.

The main control unit 701 a microprocessor unit that generally controlsthe portable information terminal 700. The system bus 702 is a datacommunication path for performing the data sending/receiving between themain control unit 701 and respective operation blocks in the portableinformation terminal 700.

The ROM 703 is a memory storing therein a basic operation program suchas an operating system and other operation programs, for which arewritable ROM such as an EEPROM or a flash ROM may be used, forexample. The RAM 704 is a work area in executing the basic operationprogram or other operation programs. The ROM 703 and the RAM 704 may beintegrally formed together with the main control unit 701. Moreover, theROM 703 may not be necessarily formed into an independent configurationas shown in FIG. 5A, but may use a partial storage area in the storageunit 710.

The storage unit 710 stores therein the operation program or operationsetting values for the portable information terminal 700, personalinformation of a user of the portable information terminal 700, and thelike. In addition, the storage unit 710 may store therein the operationprogram downloaded from over the network, various pieces of data createdby means of the operation program, and the like. Moreover, the storageunit 710 may store therein the content such as a moving picture, a stillimage, and audio which are downloaded from over the network. A partialarea of the storage unit 710 may be used instead of all or a part of thefunctions of the ROM 703. Further, the storage unit 710 is required tomaintain the stored information, even if the portable informationterminal 700 is in a state of being not externally supplied with power.Therefore, for example, used for the storage unit 710 is a deviceincluding a flash ROM, an SSD, and an HDD.

Note that the respective operation programs stored in the ROM 703 or thestorage unit 710 may be updated and extended in function through adownload process from the respective server devices on the Internet 200.

The communication processing unit 720 includes a LAN communication unit721, a mobile telephone network communication unit 722, and an NFCcommunication unit 723. The LAN communication unit 721 is connected viathe router device 210 with the Internet 200 to send and receive the datato and from the respective server devices on the Internet 200. Theconnection with router device 210 may be performed through the wirelessconnection such as the Wi-Fi (registered trademark). The mobiletelephone network communication unit 722 performs the telephonecommunication (phone call) and the data sending/receiving by way of thewireless communication with the base station 600 b of the mobiletelephone communication network. The NFC communication unit 723 performsthe wireless communication in a state of proximity to a correspondingreader/writer. The LAN communication unit 721, the mobile telephonenetwork communication unit 722, and the NFC communication unit 723 eachmay include an encoding circuit, a decoding circuit, and an antenna.Additionally, the communication processing unit 720 may further includeother communication units such as a BlueTooth (registered trademark)communication unit, and an infrared communication unit.

The expansion interface unit 724, which is a group of interfaces forextending the function of the portable information terminal 700, mayinclude a video/audio interface, a USB interface, and a memoryinterface, in the embodiment. The video/audio interface inputs a videosignal/audio signal from an external video/audio output device, outputsa video signal/audio signal to an external video/audio input device, orthe like. The USB interface is connected with a PC or the like to sendand receive the data. Moreover, the USB interface may is connected witha keyboard or other USB devices. The memory interface is connected witha memory card or other memory media to send and receive the data.

The operation unit 730, which is an instruction input unit for inputtingan operation instruction to the portable information terminal 700,includes a touch panel 730 t arranged to be overlaid on a display unit741 and an operation key 730 k having button switches arranged thereon,in the embodiment. Only either one of the touch panel 730 t and theoperation key 730 k may be used. The keyboard connected to the expansioninterface unit 724 or the like may be used for operating the portableinformation terminal 700. Another body of portable terminal deviceconnected by way of the wired communication or the wirelesscommunication may be used for operating the portable informationterminal 700. In addition, a function of the touch panel may be providedto the display unit 741.

The image processing unit 740 includes the display unit 741, an imagesignal processing unit 742, a first image input unit 743, and a secondimage input unit 744. The display unit 741, which is, for example, adisplay device such as a liquid crystal panel, provides image dataprocessed by the image signal processing unit 742 to the user of theportable information terminal 700. The image signal processing unit 742includes a video RAM not shown in the figure, and the display unit 741is driven on the basis of the image data input to the video RAM. Theimage signal processing unit 742 may have a function to perform, asneeded, format conversion, superimposition processing of menu or otherOSD (on screen display) signals or the like. The first image input unit743 and the second image input unit 744 each are a camera unit forinputting the image data of surroundings or objects by converting alight incident from a lens into an electrical signal by use of anelectronic device such as a CCD (charge coupled device) or a CMOS(complementary metal oxide semiconductor) sensor.

The audio processing unit 750 includes an audio output unit 751, anaudio signal processing unit 752, and an audio input unit 753. The audiooutput unit 751, which is a speaker, provides an audio signal processedby the audio signal processing unit 752 to the user of the portableinformation terminal 700. The audio input unit 753, which is amicrophone, converts voice of the user or the like into audio data to beinput thereto.

The sensor unit 760, which is a sensor group for detecting a state ofthe portable information terminal 700, includes a GPS reception unit761, a gyro sensor 762, a geomagnetic sensor 763, an acceleration sensor764, an illuminance sensor 765, and a proximity sensor 766, in theembodiment. Such a sensor group allows detecting position, inclination,direction, and motion of the portable information terminal 700,brightness of the surroundings, and a proximity condition of asurrounding object, and the like. In addition, the portable informationterminal 700 may further include another sensor such as an atmosphericpressure sensor.

The portable information terminal 700 may be a mobile phone, asmartphone, a tablet terminal, or the like. The portable informationterminal 700 may be a PDA (personal digital assistants) or a notebookPC. Moreover, the portable information terminal 700 may be a digitalstill camera, a video camera capable of shooting a moving picture, aportable game console and the like, or other portable digital equipment.

Note that the configuration example of the portable information terminal700 shown in FIG. 5A includes many components not necessarily requiredfor the embodiment such as the sensor unit 760, but even a configurationnot including these components do not impair the effects of theembodiment. Additionally, a configuration not shown in the figure suchas the digital broadcasting receiving function or an electronic moneysettlement function may be further added to the portable informationterminal 700.

[Software Configuration of Portable Information Terminal]

FIG. 5B is a software configuration diagram of the portable informationterminal 700 in the embodiment, and shows a configuration of software inthe ROM 703, the RAM 704, and the storage unit 710. In the embodiment,stored in the ROM 703 are a basic operation program 7001 and otheroperation programs, and stored in the storage unit 710 are a cooperationcontrol program 7002, an HTML browser program 7003, and other operationprograms. Additionally, the storage unit 710 may include a contentstorage area 7011 for storing the content such as the moving picture,the still image, and the audio, an authentication information storagearea 7012 for storing authentication information used in cooperativeoperation or the like with the television, and a various piecesinformation storage area for storing other various pieces ofinformation.

The basic operation program 7001 stored in the ROM 703 is expanded onthe RAM 704, and further, the main control unit 701 executes theexpanded basic operation program such that a basic operation executionunit 7101 is configured. The cooperation control program 7002 and theHTML browser program 7003 stored in the storage unit 710 each areexpanded on the RAM 704, and further, the main control unit 701 executesthe expanded respective operation programs such that a cooperationcontrol execution unit 7102 and an HTML browser engine 7103 areconfigured. Moreover, the RAM 704 may include a transient storage areafor transiently holding, as needed, the data created in executing eachoperation program.

Note that, in the following description for the purpose of simplifyingthe description, a description is given assuming that the process inwhich the main control unit 701 expands the basic operation program 7001stored in the ROM 703 on the RAM 704 and executes it to control therespective operation blocks is a process in which the basic operationexecution unit 7101 controls the respective operation blocks. Otheroperation programs are also described similarly.

The cooperation control execution unit 7102 manages deviceauthentication and connection, sending/receiving of each data, and thelike in a coorporative operation with the television by the portableinformation terminal 700. The HTML browser engine 7103 is an HTMLbrowser which executes the application created for broadcastcommunication cooperation system on the portable information terminal700.

Each operation program may be in a state of being stored in the ROM 703and/or the storage unit 710 in advance at the time of product shipment.The operation program may be those acquired from other applicationservers 500 or the like over the Internet 200 via the LAN communicationunit 721 or the mobile telephone network communication unit 722 afterproduct shipment. Moreover, the operation program stored in the memorycard, the optical disc or the like may be acquired via the expansioninterface unit 724 and the like.

[Outline of Application Information Table (AIT)]

The application information table (AIT) in the embodiment may beinformation intended, in the broadcast communication cooperationfunction to which the broadcast receiving device 100 is adapted, tonotify the television or the like (broadcast receiving device 100 in theembodiment) of a presence of an application cooperative with thebroadcast service (hereinafter, referred to as broadcast cooperative appin some cases) and to instruct the relevant television to control of therelevant application. Note that the broadcast cooperative app may beclassified into (1) a broadcast managed application which operates onlyin a broadcast receiving state on the basis of control signals forrun/end and the like contained in the broadcast signal, and is permittedto access a broadcast resource on the basis of the control signal, (2) anon-broadcast managed application which operates in a form where therun/end is not controlled by way of the broadcast signal, and ispermitted to access a broadcast resource on the basis of means such asthe application authentication, and (3) other general applications whichare not permitted to access a broadcast resource.

A transmission scheme for AIT may be any of those transmitting the AITdescribed in a section format or XML (extensible markup language) formatby way of the broadcast wave in a data carousel (DC) format or the like,or delivering the AIT file described in the section format or XML formatfrom the server device over the Internet 200 using a http (hypertexttransfer protocol) or a https (hypertext transfer protocol secure) orthe like. Other schemes may be used.

FIG. 6 is a data configuration diagram showing an example of a dataconfiguration for AIT. The AIT mainly includes information such as anapplication type 901, an application identifier 902, and applicationcontrol code 903, an application profile 904, an application-acquiredsite information 905, an application boundary and access authoritysetting 906, a start priority 907, cache information 908, and a serveraccess distribution parameter 909. Further, other information may beincluded.

The application type 901 defines a description format of theapplication. In the embodiment, the description format of theapplication may be the HTML. The application identifier 902 isidentification information for identifying an application unit includingan organization identification for identifying the provider and anapplication identification numbered per the provider. Note that theapplication unit is a set of an HTML document and its reference resourcein which the HTML document is present at a location specified by theapplication-acquired site information 905 and used as an entry document.The application control code 903 defines operation control for a targetapplication and describes one of (1) automatic start, (2) operable, (3)end, and (4) prefetch. The application profile 904, which is a valuerepresenting a function of the television required by the application,indicates the functions the television has as options in a combinedform. Reference to this value allows determining whether or not theapplication can be used.

The application-acquired site information 905, which is information toidentify a site for acquiring an application, is location informationfor acquiring an HTML document that is to be initially referred inrunning the application. The application may be assumed to betransmitted by broadcasting in one case and to be placed on the serverdevice over a communication network in the other case, and thus, thelocation information specified by the application-acquired siteinformation 905 is also defined correspondingly to both cases ofbroadcast acquisition and communication acquisition. The applicationboundary and access limitation setting 906 is information indicating arange operable as a broadcast managed application in a form of a set ofone or more areas (URL: uniform resource locator). In addition, anaccess limitation to the broadcast resource for each area is set interms of a function unit. The application boundary and access limitationsetting 906 specifies a range of document transition in order to preventtransition to an unexpected document through the continuous documenttransitions from the entry document at a time of running theapplication, access to an inappropriate broadcast resource, or the like.Moreover, access authority for a special broadcast resource in units ofarea in the range of the document transition can be set.

The running priority 907 defines, in a case where there are at the sametime both the data broadcasting by means of the broadcast service andthe broadcast managed application by means of the HTML document, whichone is to run with higher priority. It may be possible tounconditionally designate the data broadcasting as the highest priorityon the PMT, designate a running priority order of a special applicationtype on the PMT, and designate the running priority of the targetapplication by the running priority 907. The cache information 908 isinformation used for cache control in a case where an applicationresource is maintained in preparation for reuse of the application. Thisinformation allows the application resource to be cached even after theapplication ends on an assumption of the reuse thereof. The serveraccess distribution parameter 909 is a parameter set for distributingaccesses for the purpose of reducing load on the server on which theaccesses concentrate at the site for acquiring an application or thelike. The television may operate so as to probabilistically delayapplying the application control code in accordance with this parametersetting.

Hereinafter, a description is given of an operation of the broadcastreceiving device 100 in the embodiment.

[Operational Sequence in Running Application]

First, a description is given of a running process of the broadcastcooperative app on the basis of the AIT sent by way of the broadcastwave in the broadcast receiving device 100 in the embodiment. Thebroadcast receiving device 100 in the embodiment can define, in a casewhere there are at the same time both the data broadcasting by means ofthe broadcast service and the broadcast cooperative app, which one is torun with higher priority in accordance with the information on the PMTand the information such as the application control code 903 and runningpriority 907 in the AIT.

FIG. 7A is an operational sequence diagram showing an example of anoperational sequence of the broadcast cooperative app in the case wherethe broadcast cooperative app is defined so as to run with higherpriority. This figure illustrates a series of flows until the broadcastreceiving device 100 appropriately confirms the PMT and the AIT to run apredetermined broadcast cooperative app.

If the tuner/demodulation unit 131 in the broadcast receiving device 100performs a process for selecting a channel desired by the user toacquire the TS, then, the main control unit 101 acquires a PMT data rowseparated by the first separation unit 132 (S101), and confirms therunning priority described in the PMT. In the process at S101, if therunning priority of the broadcast cooperative app is confirmed to behigher (S102), then, the application control unit 161 acquires an AITdata row separated by the first separation unit 132 (S103), and confirmsthe application control code 903 of the acquired AIT data row (S104). Ina case where the application control code 903 is “automatic run” in theprocess at S104, the application profile 904 of the acquired AIT datarow is further confirmed (S105), and in a case where the execution ofthe broadcast cooperative app specified in the AIT is confirmed to beenabled, a request to send the broadcast cooperative app is sent via theLAN communication unit 121 to a predetermined service provider server400 on the basis of the information described in theapplication-acquired site information 905 (S106).

The service provider server 400 having received the request to send thebroadcast cooperative app performs, as needed, the authenticationprocess for the broadcast receiving device 100 on the basis of thecontrol by the application management/distribution execution unit 4103,and thereafter, delivers a predetermined broadcast cooperative appstored in the application storage area 4013 via the LAN communicationunit 421 (S107). Note that the authentication process may be performedusing a known method, and a detailed description thereof is omitted.Next, the application engine 162 in the broadcast receiving device 100runs the predetermined broadcast cooperative app which is delivered fromthe service provider server 400 and received via the LAN communicationunit 121 on the basis of the control by the application control unit 161(S108).

FIG. 7B is an operational sequence diagram showing an example of anoperational sequence of the broadcast cooperative app in the case wherethe data broadcasting by means of the broadcast service is defined so asto run with higher priority. This figure illustrates a series of flowsuntil the broadcast receiving device 100 appropriately confirms the PMTand the AIT to run a predetermined broadcast cooperative app.

If the tuner/demodulation unit 131 in the broadcast receiving device 100performs a process for selecting a channel desired by the user toacquire the TS, then, the main control unit 101 acquires a PMT data rowseparated by the first separation unit 132 (S201), and confirms therunning priority described in the PMT. In the process at S201, if therunning priority of the data broadcasting by means of the broadcastservice is confirmed to be higher (S202), the data broadcast receptionprocessing unit 141 acquires a BML data row separated by the firstseparation unit 132 to reproduce a BML document (S203). In a case wherethe automatic run for the data broadcasting is set in the BML document,and the user uses an operation terminal (portable information terminal700, remote, etc.) to make a request to run the data broadcasting(S204), the data broadcast engine 142 executes the reproduced BMLdocument to generate and display on the video display unit 173 the databroadcast screen information (S205).

After the process at S205, or at the same time as the process at S205,the application control unit 161 acquires an AIT data row separated bythe first separation unit 132 (S206), and confirms the applicationprofile 904 of the acquired AIT data row (S207). In a case where theexecution of the broadcast cooperative app specified in the AIT isconfirmed to be enabled in the process at S207, an entry button for theexecutable broadcast cooperative app is displayed on the data broadcastscreen. The entry button may be usually displayed, and color arrangementthereof may be changed from a non-active color to an active color onlywhen the execution of the broadcast cooperative app is enabled. Anon-active state and an active state of the entry button may be switchedby changing a shape thereof.

If the user uses the operation terminal to select the entry button(S208), the data broadcast engine 142 executes the BML document to endthe process for generating the data broadcast screen information (S209).Subsequently, the application control unit 161 acquires an AIT data rowseparated by the first separation unit 132 (S210), and confirms theapplication-acquired site information 905 of the acquired AIT data row.Further, a request to send the broadcast cooperative app is sent via theLAN communication unit 121 to a predetermined service provider server400 (S211) on the basis of the information described in theapplication-acquired site information 905 which is confirmed at S210.

The service provider server 400 having received the request to send thebroadcast cooperative app performs, as needed, the authenticationprocess for the broadcast receiving device 100 on the basis of thecontrol by the application management/distribution execution unit 4103,and thereafter, delivers a predetermined broadcast cooperative appstored in the application storage area 4013 via the LAN communicationunit 421 (S212). Next, the application engine 162 in the broadcastreceiving device 100 runs the predetermined broadcast cooperative appwhich is delivered from the service provider server 400 and received viathe LAN communication unit 121 on the basis of the control by theapplication control unit 161 (S213).

FIG. 7C is an operational sequence diagram showing an example of anoperational sequence of the broadcast cooperative app in a case where norunning with priority is defined. This figure illustrates a series offlows until the broadcast receiving device 100 appropriately confirmsthe PMT and the AIT to run a predetermined broadcast cooperative app.

If the tuner/demodulation unit 131 in the broadcast receiving device 100performs a process for selecting a channel desired by the user toacquire the TS, then, the main control unit 101 acquires a PMT data rowseparated by the first separation unit 132 (S301), and confirms therunning priority described in the PMT. In the process at S301, if therunning priority of the broadcast cooperative app is confirmed to behigher (S302), then, the application control unit 161 acquires an AITdata row separated by the first separation unit 132 (S303), and confirmsthe application control code 903 of the acquired AIT data row (S304). Ina case the application control code 903 is not “automatic run” but “runenabled” in the process at S304, neither the data broadcasting by meansof the broadcast service nor the broadcast cooperative app runs, and thebroadcast program is continued to be displayed.

In a case where the user uses the operation terminal to make a requestto run the data broadcasting in a state after completing the process atS304 (S305), the acquisition of the BML data row, the reproduction ofthe BML document, the generation of the data broadcast screeninformation and the like are performed similarly to S205 and subsequentprocesses in FIG. 7B (but, not shown in the figure). On the other hand,in a case where the user uses the operation terminal to make a requestto run a broadcast cooperative app launcher in a state after completingthe process at S304 (S306), the application control unit 161 acquires aAIT data row separated by the first separation unit 132 (S307), andconfirms the application profile 904 of the acquired AIT data row(S308). Further, the application control unit 161 displays a list of theexecutable broadcast cooperative app as the broadcast cooperative applauncher on the video display unit 173 (S309).

If the user uses the operation terminal to select a predeterminedbroadcast cooperative app from the broadcast cooperative app launcherdisplayed at S309 (S310), the application control unit 161 acquires anAIT data row separated by the first separation unit 132 (S311), andconfirms the application-acquired site information 905 of the acquiredAIT data row. Further, a request to send the broadcast cooperative appis sent via the LAN communication unit 121 to a predetermined serviceprovider server 400 (S312) on the basis of the information described inthe application-acquired site information 905 which is confirmed atS311.

The service provider server 400 having received the request to send thebroadcast cooperative app performs, as needed, the authenticationprocess for the broadcast receiving device 100 on the basis of thecontrol by the application management/distribution execution unit 4103,and thereafter, delivers a predetermined broadcast cooperative appstored in the application storage area 4013 via the LAN communicationunit 421 (S313). Next, the application engine 162 in the broadcastreceiving device 100 runs the predetermined broadcast cooperative appwhich is delivered from the service provider server 400 and received viathe LAN communication unit 121 on the basis of the control by theapplication control unit 161 (S314).

Note that the any running sequence of the broadcast cooperative appdescribed with reference to FIG. 7A to FIG. 7C describes the example inwhich the AIT is acquired from the broadcast wave, but the AIT file maybe acquired from a predetermined server device specified by informationdescription in the PMT or the like. Moreover, the broadcast cooperativeapp may be acquired not from the server device over the network (serviceprovider server 400) but from the broadcast wave. In other words, in thecase where the location information described in theapplication-acquired site information 905 in the AIT indicates thebroadcast wave, the application control unit 161 may reproduce the HTMLdocument from the HTML data row which is sent in the data carouselformat or the like, and separated and output by the first separationunit 132, and the application engine 162 may execute the reproduced HTMLdocument (broadcast cooperative app).

Note that in a case where the PMT has thereon no information designatingthe running priority in the case where there are at the same time boththe data broadcasting by means of the broadcast service and thebroadcast cooperative app, the running priority may be confirmed inaccordance with only the information such as the application controlcode 903 and running priority 907 in the AIT. Similarly, also in a casewhere the information on PMT fails to be acquired, the running prioritymay be confirmed in accordance with only the information such as theapplication control code 903 and running priority 907 in the AIT. Inother words, without depending on the information on the PMT, the AITmay be periodically confirmed, and in the case where the broadcastcooperative app designated as “automatic run” in the application controlcode 903 in the AIT is present, the running of the broadcast cooperativeapp may have priority, and in the case where the broadcast cooperativeapp designated as “automatic run” in the application control code 903 inthe AIT is absent, the running of the data broadcasting by means of thebroadcast service may have priority.

Additionally, when the request to deliver the broadcast cooperative appis made at S106, S211, and S312, if a response is not returned from theservice provider server 400 for a predetermined time period or more, amessage such as “please wait a moment” may be displayed on the videodisplay unit 173. Alternatively, in this case, a massage asking the userabout whether to stop execution of the broadcast cooperative app may bedisplayed.

Moreover, the running sequence of the broadcast cooperative app is notlimited to three patterns described above, and, needless to say, thebroadcast cooperative app may run in a different sequence.

[Operational Sequence in Cooperation of Portable Information Terminal]

The broadcast receiving device 100 in the embodiment may be extended infunction of the broadcast communication cooperation service owing to thecooperative operation between the broadcast receiving device 100 and theportable information terminal 700. For example, an application preparedby a manufacturer of the television (cooperation control app) may beinstalled to allow the portable information terminal 700 to be used as ahigh functional remote for the broadcast receiving device 100. Further,the broadcast cooperative app may be executed also on the portableinformation terminal 700 to be able to, for example, display a servicelinked to the broadcast program being displayed on the broadcastreceiving device 100 also on the portable information terminal 700. Notethat in order to expand in function owing to the cooperative operationbetween the broadcast receiving device 100 and the portable informationterminal 700, the cooperation control app preferably runs on theportable information terminal 700 where the broadcast cooperative appoperating on the portable information terminal 700 may operate undercontrol of the cooperation control app.

FIG. 8A is an operational sequence diagram showing an example of anoperational sequence in running the cooperation control app in theportable information terminal 700. This figure illustrates a series offlows (first time) until the portable information terminal 700 performsthe authentication process with respect to the broadcast receivingdevice 100 and the cooperative operation become enabled. Note that thecooperation control app may have installed therein in advance thestorage unit 710 in the portable information terminal 700 as acooperation control program 7002.

If the user instructs start of the cooperation control app on theportable information terminal 700 (S401), a cooperation controlexecution unit 7102 in the portable information terminal 700 searches acommunication (cooperative operation) enabled television over thenetwork (S402), and displays a search result as a television list on thedisplay unit 741. In a case where the communication enabled televisionis not found, that effect is displayed and the process ends. If the userselects any television (broadcast receiving device 100 in theembodiment) from the television list, the cooperation control executionunit 7102 displays a login screen for connecting to the broadcastreceiving device 100 on the display unit 741. If the user inputs theauthentication information (login name and password specified by thebroadcast receiving device 100, etc.) via the operation unit 730 to thelogin screen (S403), the cooperation control execution unit 7102 storesthe input authentication information in the authentication informationstorage area 7012 and, at the same time, sends the authenticationinformation to the broadcast receiving device 100 (S404). If the userinstructs, on the portable information terminal 700, the cooperationcontrol app to run (S401), a cooperation control execution unit 7102 inthe portable information terminal 700 searches a communication(cooperative operation) enabled television over the network (S402), anddisplays a search result as a television list on the display unit 741.

The terminal cooperation control unit 191 in the broadcast receivingdevice 100 having received the authentication information via the LANcommunication unit 121 refers to the authentication information storagearea 1012 to confirm whether or not the received authenticationinformation is correct (S405). In a case where the receivedauthentication information is confirmed to be correct in the process atS405, the information on the portable information terminal 700 is storedin the authentication information storage area 1012 and the portableinformation terminal 700 is authenticated (S406). The portableinformation terminal 700 authenticated by the broadcast receiving device100 displays a base screen for the cooperation control app (e.g., highfunctional remote screen) on the display unit 741 (S407). In a casewhere the received authentication information is not confirmed to becorrect at S405, the terminal cooperation control unit 191 in thebroadcast receiving device 100 returns an error to the portableinformation terminal 700. The above processes allow a state where thecooperative operation is enabled between the broadcast receiving device100 and the portable information terminal 700.

FIG. 8B is an operational sequence diagram showing an example of anoperational sequence in running the cooperation control app in theportable information terminal 700. This figure illustrates a series offlows (second and subsequent times) until the portable informationterminal 700 performs the authentication process with respect to thebroadcast receiving device 100 and the cooperative operation becomingenabled.

If the user instructs, on the portable information terminal 700, thecooperation control app to run (S501), the cooperation control executionunit 7102 in the portable information terminal 700 searches acommunication enabled television over the network, and displays a searchresult as the television list on the display unit 741. In a case wherethe communication enabled television is not found, that effect isdisplayed and the process ends. If the user selects any television(broadcast receiving device 100 in the embodiment) the from televisionlist (S502), and the selected broadcast receiving device 100 is a devicehaving been in connection (cooperative operation) with the terminal atan earlier time, the cooperation control execution unit 7102 reads outthe authentication information for the broadcast receiving device 100from the authentication information storage area 7012 to send to thebroadcast receiving device 100 (S503).

The terminal cooperation control unit 191 in the broadcast receivingdevice 100 having received the authentication information via the LANcommunication unit 121 refers to the authentication information storagearea 1012 to confirm whether or not the received authenticationinformation is correct (S504). In a case where the receivedauthentication information is confirmed to be correct in the process atS504, the portable information terminal 700 is authenticated (S505). Theportable information terminal 700 authenticated by the broadcastreceiving device 100 displays the base screen for the cooperationcontrol app on the display unit 741 (S506). The above processes allow astate where the cooperative operation is enabled between the broadcastreceiving device 100 and the portable information terminal 700.

Note that in running the broadcast cooperative app in the broadcastreceiving device 100 subsequently to the process in FIG. 8A to FIG. 8B,the process in FIG. 7A to FIG. 7C may be performed after the process inFIG. 8A to FIG. 8B.

FIG. 8C is an operational sequence diagram showing an example of anoperational sequence in running the cooperation control app in theportable information terminal 700. This figure illustrates a series offlows (second and subsequent times) until the portable informationterminal 700 performs the authentication process with respect to thebroadcast receiving device 100 and the cooperative operation becomeenabled. However, this figure shows an example of a case where thebroadcast receiving device 100 executing the running sequence of thebroadcast cooperative app requests to run the cooperation control app onthe portable information terminal 700.

If the tuner/demodulation unit 131 in the broadcast receiving device 100performs a process for selecting a channel desired by the user toacquire the TS, then, the main control unit 101 acquires a PMT data rowseparated by the first separation unit 132 (S601), and confirms therunning priority described in the PMT. In the process at S601, if therunning priority of the broadcast cooperative app is confirmed to behigher (S602), then, the application control unit 161 acquires an AITdata row separated by the first separation unit 132 (S603), and confirmsthe application control code 903 of the acquired AIT data row (S604). Ina case where the application control code 903 is “automatic run” in theprocess at S604, the application profile 904 of the acquired AIT datarow is further confirmed (S605). In a case where the execution of thebroadcast cooperative app specified in the AIT is confirmed to beenabled in the process at S605, and further, the portable terminaldevice is determined to require to be subjected to the cooperationcontrol, the terminal cooperation control unit 191 refers to theauthentication information storage area 1012 to select the portableinformation terminal 700 as the portable terminal device and sends arequest to run the cooperation control app to the selected portableinformation terminal 700 (S606).

Note that the selection of the portable information terminal 700 bymeans of referring to the authentication information storage area 1012may be based on the latest information of the authentication informationstorage area 1012 or based on the most frequently used information ofthe authentication information storage area 1012.

In a case where the portable terminal device to which a request to runthe cooperation control app is to be sent is not found in the process atS606, a message representing that effect may be displayed on the videodisplay unit 173. Alternatively, in this case, a massage asking the userabout whether to stop execution of the broadcast cooperative app may bedisplayed.

The main control unit 701 in the portable information terminal 700 runsthe cooperation control app (cooperation control execution unit 7102) inresponse to the request to run the cooperation control app received viathe LAN communication unit 721 (S607), and further, the cooperationcontrol execution unit 7102 reads out the authentication information forthe broadcast receiving device 100 from the authentication informationstorage area 7012 to send to the broadcast receiving device 100 (S608).

The terminal cooperation control unit 191 in the broadcast receivingdevice 100 having received the authentication information via the LANcommunication unit 121 refers to the authentication information storagearea 1012 to confirm whether or not the received authenticationinformation is correct (S609). In a case where the receivedauthentication information is confirmed to be correct in the process atS609, the portable information terminal 700 is authenticated (S610). Theportable information terminal 700 authenticated by the broadcastreceiving device 100 displays the base screen for the cooperationcontrol app on the display unit 741 (S611). The above processes allow astate where the cooperative operation is enabled between the broadcastreceiving device 100 and the portable information terminal 700.

Note that in a case where the broadcast cooperative app is executed onboth the broadcast receiving device 100 and the portable informationterminal 700 subsequently to the above described process, the processshown in FIG. 9 may be performed. FIG. 9 is an operational sequencediagram showing an example of a running sequence of the broadcastcooperative app in the broadcast receiving device 100 and the portableinformation terminal 700.

In other words, after the process at S601 to S611 in FIG. 8C, theapplication control unit 161 in the broadcast receiving device 100acquires an AIT data row separated by the first separation unit 132(S612), and confirms the application-acquired site information 905 ofthe acquired AIT data row. Further, a request to send the broadcastcooperative app (on the television side) is sent via the LANcommunication unit 121 to a predetermined service provider server 400(S613) on the basis of the information described in theapplication-acquired site information 905 which is confirmed at S612.

The service provider server 400 having received the request to send thebroadcast cooperative app (on the television side) performs, as needed,the authentication process for the broadcast receiving device 100 on thebasis of the control by the application management/distributionexecution unit 4103, and thereafter, delivers a predetermined broadcastcooperative app (on the television side) stored in the applicationstorage area 4013 via the LAN communication unit 421 (S614). Theapplication engine 162 in the broadcast receiving device 100 runs thepredetermined broadcast cooperative app (on the television side) whichis delivered from the service provider server 400 and received via theLAN communication unit 121 on the basis of the control by theapplication control unit 161 (S615).

Next, the terminal cooperation control unit 191 sends, to the portableinformation terminal 700, URL information or the like of a site foracquiring a broadcast cooperative app (on the terminal side) which is tobe executed in the portable information terminal 700 in the broadcastreceiving device 100 (S616), the URL information or the like beingacquired from the AIT or the broadcast cooperative app (on thetelevision side) executed at S615. The cooperation control executionunit 7102 in the portable information terminal 700 sends a request tosend the broadcast cooperative app (on the terminal side) via the LANcommunication unit 721 to a predetermined service provider server 400 onthe basis of the URL information or the like of a site for acquiring thebroadcast cooperative app (on the terminal side) which is received viathe LAN communication unit 721 (S617).

The service provider server 400 having received the request to send thebroadcast cooperative app (on the terminal side) performs, as needed,the authentication process for the portable information terminal 700 onthe basis of the control by the application management/distributionexecution unit 4103, and thereafter, delivers a predetermined broadcastcooperative app stored in the application storage area 4013 (on theterminal side) via the LAN communication unit 421 (S618). The HTMLbrowser engine 7103 in the portable information terminal 700 runs thepredetermined broadcast cooperative app (on the terminal side) which isdelivered from the service provider server 400 and received via the LANcommunication unit 721 (S619).

Note that similarly to the operational sequences in FIG. 7A to FIG. 7C,the AIT file may be acquired from a predetermined server device, and thebroadcast cooperative app may be acquired not from the server deviceover the network but from the broadcast wave. Note that in the casewhere the broadcast cooperative app is acquired from the broadcast wave,the broadcast receiving device 100 may acquire from the broadcast wavethe broadcast cooperative app (on the terminal side) which is to beexecuted in the portable information terminal 700, and transfer theacquired broadcast cooperative app (on the terminal side) via thecommunication unit 121 to the portable information terminal 700.Alternatively, the broadcast receiving device 100 may acquire from thebroadcast wave the broadcast cooperative app (on the terminal side)which is to be executed in the portable information terminal 700 tostore in the storage unit 110, and send the location information of thestorage unit 110 in the broadcast receiving device 100 as the URLinformation to be sent to the portable information terminal 700 in theprocess at S616 in FIG. 9. The broadcast receiving device 100 mayacquire the broadcast cooperative app (on the television side) from thebroadcast wave, and the portable information terminal 700 may acquirethe broadcast cooperative app (on the terminal side) from the serverdevice over the network. The digital broadcasting receiving functionwhich the portable information terminal 700 has may be used to directlyacquire the broadcast cooperative app (on the terminal side) from thebroadcast wave.

Additionally, portions of the operational sequences in FIG. 7A to FIG.7C, FIG. 8A to FIG. 8C, and FIG. 9 may be appropriately combined witheach other, and further, a part of operational steps may appropriatelybe replaced in the order with or performed at the same time as anotheroperational step, or the like.

[Cooperation Control App Base Screen of Portable Information Terminal]

FIG. 10A is a screen display illustration showing an example of the basescreen for the cooperation control app displayed in the process at S407in FIG. 8A, the process at S506 in FIG. 8B, the process at S611 in FIG.8C, or the like. In the embodiment, a base screen 741 a for thecooperation control app may have a function as a high functional remotecorresponding to the broadcast receiving device 100.

The base screen 741 a for the cooperation control app includes, as shownin FIG. 10A, a power key 741 a 1, a network selection key (DTT (digitalterrestrial television), BS, CS) 741 a 2, a numeric key (1 to 12) 741 a3, a volume level UP/DOWN key 741 a 5, a channel UP/DOWN key 741 a 5, aninput switch key 741 a 6, a program schedule key 741 a 7, a data key 741a 8, a cooperative app key 741 a 9, a menu key 741 aa, a return key 741ab, cursor keys (up, down, left, right) 741 ac, an enter key 741 ad, andcolor keys (blue, red, green, yellow) 741 ae. Other operation keys maybe further displayed.

The respective operation keys using a key arrangement/operation similarto a dedicated remote associated with the broadcast receiving device 100is easy-to-use. Additionally, the power key 741 a 1, the networkselection key 741 a 2, the numeric key 741 a 3 or the like may have afunction similar to each operation key of the remote for a known TV set,and a detailed description thereof is omitted. The cooperative app key741 a 9 is an operation key provided for a broadcast cooperativecommunication function in the embodiment.

Note that in the processes at S204 in FIG. 7B and at S305 in FIG. 7C,the data broadcasting may be run/ended by selecting the data key 741 a8. In the processes at S208 in FIG. 7B and at S310 in FIG. 7C, theexecutable broadcast cooperative app may be selected by operating thecursor key 741 ac and the enter key 741 ad. In the process at S306 inFIG. 7C, a request to run the broadcast cooperative app launcher may bemade by selecting the cooperative app key 741 a 9.

In this way, if the cooperative app key 741 a 9 or another operation keyhaving the similar function is provided on the base screen 741 a for thecooperation control app, each broadcast cooperative app used in thebroadcast cooperative system in the embodiment may be easilyselected/run.

FIG. 10B is a screen display illustration showing an example of the basescreen for the cooperation control app displayed in the process at S407in FIG. 8A, the process at S506 in FIG. 8B, the process at S611 in FIG.8C, or the like, and shows an example different from FIG. 10A.

The base screen 741 b for the cooperation control app includes aduring-cooperation control message 741 b 1, and a cooperation controlapp operation screen 741 b 2. Other objects may be further displayed.The during-cooperation control message 741 b 1 is message displaying formaking the user recognize that the portable information terminal 700 isin the cooperative operation with the broadcast receiving device 100.The cooperation control app operation screen 741 b 2 is an area wherethe cooperation control app performs any screen displaying, a detaileddescription thereof is omitted in the embodiment. For example, aconfiguration within the cooperation control app operation screen 741 b2 may be the same as the configuration of the base screen 741 a for thecooperation control app described above. A subscreen for the broadcastprogram displayed on the broadcast receiving device 100 may bedisplayed.

As shown in FIG. 10B, the during-cooperation control message 741 b 1 isdisplayed such that the user of the portable information terminal 700may easily grasp that the portable information terminal 700 is in thecooperative operation with the broadcast receiving device 100. Note thatthe during-cooperation control message 741 b 1 is not limited tocharacter displaying, but may be by means of symbol displaying, graphicdisplaying, and the like. A background color may be differentiatedinstead of using the during-cooperation control message 741 b 1.

[Data Broadcast Screen of Broadcast Receiving Device]

FIG. 11 is a screen display illustration showing an example of a databroadcast screen displayed in the process at S205 in FIG. 7B. In theembodiment, three broadcast cooperative apps of a cooperative app A, acooperative app B, and a cooperative app C are assumed to be in a stateof being executable in the broadcast receiving device 100 in accordancewith the description in the AIT or the like. In this case, an entrybutton 173 a 2 for the cooperative app A, an entry button 173 a 3 forthe cooperative app B, and an entry button 173 a 5 of the cooperativeapp C are displayed at any position on a data broadcast screen 173 a.

In the data broadcast screen 173 a as shown in FIG. 11, when the cursorkey 741 ac and the enter key 741 ad in the base screen 741 a for thecooperation control app are used to select the entry button 173 a 2, theentry button 173 a 3, the entry button 173 a 5 or the like, displayingof the data broadcast screen 173 a is ended, and the cooperative app A,the cooperative app B, the cooperative app C, or the like runs undercontrol by the application control unit 161 and the application engine162.

Note that, in displaying the data broadcast screen 173 a, a frame color,inside color, shape, font, size, blinking condition, and the like ofeach entry button may be appropriately changed depending on a kind,security status or the like of the broadcast cooperative app. Forexample, in a case where the cooperative app A is a broadcast managedapplication, the frame color of the entry button 173 a 2 may be blue, incase where the cooperative app B is a non-broadcast managed application,the frame color of the entry button 173 a 3 may be yellow, and in a casewhere the cooperative app C is a general application, the frame color ofthe entry button 173 a 5 may be red, and so on. Alternatively, in a casewhere the cooperative app A is determined to be reliable in terms ofsecurity, the frame color of the entry button 173 a 2 may be blue, in acase where the cooperative app B is not necessarily determined to bereliable in terms of security, the frame color of the entry button 173 a3 may be yellow, and in case where the cooperative app C is determinedto be risky in terms of security, the frame color of the entry button173 a 5 may be red, and so on.

Besides, the frame color, inside color, shape, font, size, blinkingcondition, and the like of each entry button may be appropriatelychanged depending on a function or genre of the broadcast cooperativeapp, an expiration date for use of each broadcast cooperative app, orthe like. The frame color, inside color, shape, font, size, blinkingcondition, and the like of each entry button may be appropriatelychanged depending on where or not the broadcast cooperative app has beenalready acquired from over the network or the like. For example, in acase where the cooperative app A has been already acquired from over thenetwork (already cached in the RAM 104 or the storage 110), the framecolor of the entry button 173 a 2 may be blue, in a case where thecooperative app B is being acquired, the frame color of the entry button173 a 3 may be yellow, in a case where the cooperative app C has notbeen acquired yet, the frame color of the entry button 173 a 5 may bered, and so on.

By doing so, the user of the broadcast receiving device 100 is allowedto easily grasp a kind, security status or the like of the broadcastcooperative app executable in the broadcast receiving device 100.

[Broadcast Cooperative App Launcher Screen of Broadcast ReceivingDevice]

FIG. 12A is a screen display illustration showing an example of anannunciation screen for making the user recognize that a run-enabledbroadcast cooperative app is present, in the broadcast receiving device100 in the embodiment.

For example, in the operational sequence shown in FIG. 7C, after theprocess at S304, neither the data broadcasting by means of the broadcastservice nor the broadcast cooperative app runs, and the broadcastprogram is continued to be displayed. On the other hand, in this case,in order to make the user recognize that the run-enabled broadcastcooperative app is present, an icon 173 b 0 as shown in FIG. 12A may bedisplayed such that the broadcast receiving device 100 becomesincreasingly easy-to-use. In other words, by displaying the icon 173 b0, the user can be prevented from overlooking the presence of therun-enabled broadcast cooperative app.

Note that a displayed position of the icon 173 b 0 may be any positionon the screen, but preferably at a place not disturbing viewingbroadcast program. For example, four corners on the screen arepreferable. Additionally, the icon 173 b 0 may be by means of thecharacter displaying as shown in FIG. 12A, or may be the symbol, graphicor the like. Moreover, the icon 173 b 0 may be usually displayed, or maybe displayed only for a predetermined time period after the power isturned on or after the channel is switched. Alternatively, the icon maybe displayed at the same time as when the program information, thechannel number or the like is displayed.

FIG. 12B is a screen display illustration showing an example of thebroadcast cooperative app launcher in the process at S306 in FIG. 7C. Inthe embodiment, three broadcast cooperative apps of a cooperative app A,a cooperative app B, and a cooperative app C are assumed to be in astate of being executable in the broadcast receiving device 100 inaccordance with the description in the AIT or the like. In this case, abroadcast cooperative app launcher 173 b 1 is displayed at any positionon a broadcast program screen 173 b, and further, displayed in thebroadcast cooperative app launcher 173 b 1 are an entry button 173 b 2of the cooperative app A, an entry button 173 b 3 of the cooperative appB, an entry button 173 b 4 of the cooperative app C, and a return button173 b 5.

In a state where the broadcast cooperative app launcher 173 b 1 as shownin FIG. 12B is displayed, when the cursor key 741 ac and the enter key741 ad in the base screen 741 a for the cooperation control app are usedto select the entry button 173 b 2, the entry button 173 b 3, the entrybutton 173 b 4 or the like, the cooperative app A, the cooperative appB, the cooperative app C, or the like runs under control by theapplication control unit 161 and the application engine 162. In a casewhere the return button 173 b 5 is selected, displaying of the broadcastcooperative app launcher 173 b 1 is ended.

Note that, in displaying the broadcast cooperative app launcher 173 b 1on the broadcast program screen 173 b, the frame color, inside color,shape, font, size, blinking condition, and the like of each entry buttonmay be appropriately changed depending on a kind or security status ofthe broadcast cooperative app, a function or genre of the broadcastcooperative app, an acquisition status of the broadcast app from overthe network, and the like, as in the case where the entry buttons of therespective broadcast cooperative apps are displayed on the databroadcast screen 173 a in FIG. 11.

In addition, in a case where the broadcast cooperative app executable inthe broadcast receiving device 100 is not present, the broadcastcooperative app launcher 173 b 1 may not be displayed. Alternatively, inthis case, a message “usable applications is absent” or the like may bedisplayed within the broadcast cooperative app launcher 173 b 1.

[Broadcast Cooperative App Execution Screen of Broadcast ReceivingDevice]

FIG. 13A is a screen display illustration showing an example of thebroadcast cooperative app execution screen displayed in the process atS108 in FIG. 7A, the process at S213 in FIG. 7B, the process at S314 inFIG. 7C, the process at S615 in FIG. 9 or the like. The broadcastcooperative app in the embodiment has graphics capability, effectcapability or the like owing to an HTML description and may be able tomake overlay display with respect to the broadcast program screen on thevideo display unit 173. For example, as shown in FIG. 13A, a broadcastcooperative app section 173 c 1 displaying information such as weatherforecast or news is overlay-displayed at any position on the broadcastprogram screen 173 c. The broadcast cooperative app section 173 c 1includes a first main object 173 c 2, a second main object 173 c 3, athird main object 173 c 4, and a background object 173 c 5. Otherobjects may be further displayed.

In a state where the broadcast cooperative app section 173 c 1 isoverlay-displayed on the broadcast program screen 173 c, selecting thedata key 741 a 8 in the base screen 741 a for the cooperation controlapp may allow the execution of the broadcast cooperative app to be endedto transit to the data broadcast screen. Moreover, selecting thecooperative app key 741 a 9 in the base screen 741 a for the cooperationcontrol app may allow the execution of the broadcast cooperative app tobe ended to return the display where only the broadcast program screen173 c is displayed. The above processes may be attained by way of adifferent operation key.

Further, in a state where the broadcast cooperative app section 173 c 1is overlay-displayed on the broadcast program screen 173 c, selectingeach operation key in the base screen 741 a for the cooperation controlapp may allow a transparency degree of the broadcast cooperative appsection 173 c 1 to be changed. The above transparency degree changingprocess may be performed totally with respect to the entire broadcastcooperative app section 173 c 1, or independently with respective toeach of the first main object 173 c 2, the second main object 173 c 3,the third main object 173 c 4, and the background object 173 c 5. Theabove process may be performed per a predetermined group (e.g., aplurality of objects existing in the same graphics layer).

In performing the transparency degree changing process, for example, thecursor key 741 ac in the base screen 741 a for the cooperation controlapp is used to select the object, and a “blue” key of the color key 741ae is used to increase the transparency degree of the object or a“yellow” key is used to decrease the transparency degree of the object.A different operation key may be used to perform the transparency degreechanging process. If the entire broadcast cooperative app section 173 c1 is totally made to have the transparency degree of 100%, the broadcastcooperative app section 173 c 1 can be temporarily made non-displayed.For example, in a case where an emergency broadcasting is delivered byway of the broadcast wave, a broadcast program screen of the emergencybroadcasting only may be displayed on the video display unit 173 withthe entire broadcast cooperative app section being made to have thetransparency degree of 100%. Alternatively, a CM detection unit notshown in the figure may detect that broadcast program is transited froma main video to a CM video and control so as to totally make the entirebroadcast cooperative app section 173 c 1 have the transparency degreeof 100% (or, a transparency degree by which the broadcast program videocan be clearly perceived).

Performing the above process allows a broadcast program screen on thebackground to be confirmed without ending the broadcast cooperative appin a case where the broadcast program screen is needed to be confirmedduring executing the broadcast cooperative app.

FIG. 13B is a screen display illustration showing an example of thebroadcast cooperative app execution screen displayed in the process atS108 in FIG. 7A, the process at S213 in FIG. 7B, the process at S314 inFIG. 7C, the process at S615 in FIG. 9 or the like, and shows an exampledifferent from the aforementioned example. In the example shown in FIG.13B, a broadcast cooperative app section 173 c 6 introducing arecommended program is overlay-displayed at any position on thebroadcast program screen 173 c. Displayed in the broadcast cooperativeapp section 173 c 6 are a first recommended program information 173 c 7,a second recommended program information 173 c 8, a third recommendedprogram information 173 c 9, and the like. Much more pieces ofrecommended program information may be displayed through scrolling, pageswitching or the like.

The above recommended program information may be information about aprogram recommended concerning the broadcast program being displayed(broadcast program screen 173 c), information about a programrecommended on the basis of a viewing history of the user, orinformation about a program talked about in the Internet or the like. Itmay be information about a recommended program which a friend of theuser of the broadcast receiving device 100 sent to the user. Moreover,the recommended program may be a program sent by way of the broadcastwave of the digital broadcast service, a VOD (video on demand) programdelivered from the respective server devices over the Internet 200, orthe like. It may be an information screen such as a homepage prepared onthe server device over the Internet 200.

In a state where the broadcast cooperative app section 173 c 6 isoverlay-displayed on the broadcast program screen 173 c, the cursor key741 ac and the enter key 741 ad in the base screen 741 a for thecooperation control app are used to select the first recommended programinformation 173 c 7, the second recommended program information 173 c 8,the third recommended program information 173 c 9, or the like, suchthat each program video recommended in the first recommended programinformation 173 c 7, the second recommended program information 173 c 8,the third recommended program information 173 c 9, or the like isdisplayed on the display unit 173.

FIG. 13C is a screen display illustration showing an example of a casewhere a program video is displayed which is recommended in broadcastcooperative app section 173 c 6 introducing the recommended program. Forexample, in a case where the cursor key 741 ac and the enter key 741 adin the base screen 741 a for the cooperation control app are used toselect the first recommended program information 173 c 7 in thebroadcast cooperative app section 173 c 6, a program video 173 ac of aprogram recommended by the first recommended program information 173 c 7is displayed on the display unit 173. The program video 173 ac may bepaused, jumped to a specific time, or the like through operating theoperation terminal by the user. Moreover, in displaying the programvideo 173 ca, the previous broadcast program screen 173 c may bedisplayed at any position in a PIP (picture in picture) form. In thiscase, which of the program video 173 ac of the recommended program andthe previous broadcast program screen 173 c is to be the main screen maybe changed through the operation on the operation terminal by the user.A size of a window of the previous broadcast program screen 173 c may beadjusted through the operation on the operation terminal by the user.

Additionally, if an icon indication 173 cb is displayed, at any positionon the screen, which indicates that the program video 173 ac of therecommended program is the video displayed through selection of any ofthe recommended program information displayed in the broadcastcooperative app section 173 c 6, user's convenience can be improved.Further, needless to say, the transparency degree of the broadcastcooperative app section 173 c 6 may be changed also in the broadcastcooperative app execution screen shown in FIG. 13B, as is the same as inthe aforementioned example.

FIG. 13D is a screen display illustration showing an example of thebroadcast cooperative app execution screen displayed in the process atS108 in FIG. 7A, the process at S213 in FIG. 7B, the process at S314 inFIG. 7C, the process at S615 in FIG. 9 or the like, and shows an exampledifferent from the aforementioned example. In the example shown in FIG.13D, a broadcast cooperative app section 173 cc which is a portal for anSNS (social networking service) service is overlay-displayed at anyposition on the broadcast program screen 173 c. Displayed in thebroadcast cooperative app section 173 cc are an entry button 17 cd of afirst SNS service, an entry button 173 ce of a second SNS service, anentry button 173 cf of a third SNS service, and the like. Much moreentry buttons of the SNS service may be displayed through scrolling,page switching or the like.

In a state where the broadcast cooperative app section 173 cc isoverlay-displayed on the broadcast program screen 173 c, the cursor key741 ac and the enter key 741 ad in the base screen 741 a for thecooperation control app to select the entry button 17 cd of the firstSNS service, the entry button 173 ce of the second SNS service, theentry button 173 cf of the third SNS service, or the like, such that afunction assigned to each entry button such as a chat function, amessage board function, or an Internet phone function is enabled. Thismakes it possible to enjoy the broadcast program being displayed(broadcast program screen 173 c) while exchanging the information withanother user. Further, at the same time, the base screen 741 a for thecooperation control app on the portable information terminal 700 may bechanged into a character input screen such as a software keyboard, or avoice input screen for chatting or writing on the message board throughvoice input, and so on.

In addition, besides the above examples, examples of the broadcastcooperative app executable in the broadcast receiving device 100 in theembodiment may include those in which an associated CM app is presentedon both the broadcast receiving device 100 and the portable informationterminal 700 using the cooperation function between the broadcastreceiving device 100 and the portable information terminal 700 andfurther in synchronization with a CM broadcast timing. Alternatively,those may be also included in which, in a fee-based service available tothe broadcast receiving device 100, whether or not the user of thebroadcast receiving device 100 subscribes the fee-based service isconfirmed by the broadcast cooperative app, depending on a result ofwhich the displaying on the broadcast receiving device 100 and/or theportable information terminal 700 is changed. In the broadcast receivingdevice 100 in the embodiment, even in case where any broadcastcooperative app is executed, the effects described with reference toFIG. 13A, FIG. 13B or the like can be beneficially given.

[Error Display Screen of Broadcast Receiving Device]

FIG. 14 a screen display illustration showing an example of an errordisplay screen in such cases as where the execution of the broadcastcooperative app is determined to be not enabled such as throughconfirming the application profile 904 of the acquired AIT data row,where the description in the AIT has some lack, or where the AIT isfailed to be acquired in the process at S105 in FIG. 7A, the process atS207 in FIG. 7B, the process at S308 in FIG. 7C, the process at S605 inFIG. 8C, or the like.

In the broadcast receiving device 100 in the embodiment, in the casewhere the execution of the broadcast cooperative app is determined to benot enabled, the reason why the execution of the broadcast cooperativeapp is not enabled is displayed in an error message 173 d 1, such as theconfirmation result of the application profile 904. For example, in acase the television side is found lacking in a given optional functionas a result of confirming the application profile 904, that effect isdisplayed in the error message 173 d 1. A notice concerning a homepageof a television manufacturer (URL, etc.) may be displayed in which anerror code and an explanation of the error code are described.Alternatively, a connection condition of the network is naturallyconfirmed in advance in a case where the broadcast cooperative app isacquired from over the network, but, at this time, for example, if thebroadcast cooperative app cannot be acquired due to connection failureof a LAN cable or the like, that effect is displayed in the errormessage 173 d 1. In addition, also in such a case where the broadcastcooperative app cannot be accurately acquired because the networkconnection is established, but an error situation is poor, the errormessage 173 d 1 may be displayed. In a case where the acquisition of thebroadcast cooperative app is being performed and the broadcastcooperative app cannot be still executed, the error message 173 d 1 maybe displayed. Moreover, also in such a case where a receiving situationof the broadcast wave is unstable, and although the information such asthe AIT was firstly received, the information such as the AIT cannothave been received on the way, the error message 173 d 1 may bedisplayed. Note that in such cases, if the broadcast cooperative appacquired from each server device is cached as it is, it can be used asit is after the broadcast wave receiving situation is recovered.

In addition, in the case the television side is found lacking in a givenoptional function as a result of confirming the application profile 904,a recommendation for confirmation or update of the latest televisionfirmware may be displayed in the error message 173 d 1. Alternatively,the confirmation or update of the latest firmware may be automaticallymade by the broadcast receiving device 100. Alternatively, in a casewhere the execution of the broadcast cooperative app can be made enabledby adding the fee-based optional hardware or optional software to thetelevision, a notice concerning the fee-based optional hardware oroptional software may be displayed. Note that the error message 173 d 1may be displayed not on the broadcast receiving device 100 but on theportable information terminal 700.

[Broadcast Cooperative App Execution Screen of Portable InformationTerminal]

FIG. 15 is a screen display illustration showing an example of thebroadcast cooperative app (on the terminal side) execution screendisplayed in the process at S619 in FIG. 9. A broadcast cooperative appexecution screen 741 c shown in FIG. 15 includes a main window 741 c 1,a sub window 741 c 2, a selection marker 741 c 3, a cursor keys 741 c 4and 741 c 5, a commentary display unit 741 c 6, and an end button 741 c7. Other objects may be further added.

In the embodiment, the broadcast cooperative app (on the terminal side)executed in the portable information terminal 700 may be an applicationfor confirming the broadcast program details being displayed on thebroadcast receiving device 100. Moreover, the main window 741 c 1displays the same video as the broadcast program screen displayed on thebroadcast receiving device 100, and the sub window 741 c 2 displays anenlarged video corresponding to a location specified by the selectionmarker 741 c 3. The cursor keys 741 c 4 and 741 c 5 may be selected tochange the location of the selection marker 741 c 3. The commentarydisplay unit 714 c 6 displays a commentary caption text regarding thebroadcast program being displayed in the main window 741 c 1, a commentregarding the broadcast program posted by another user, or the like. Theend button 741 c 7 is a button for ending the operation of the broadcastcooperative app (on the terminal side).

The broadcast cooperative app (on the terminal side) is made to operateon the portable information terminal 700 such that the function of thebroadcast communication cooperation service can be extended owing to thecooperative operation between the broadcast receiving device 100 and theportable information terminal 700.

[EPG Screen of Broadcast Receiving Device] FIG. 16A is a screen displayillustration showing an example of an electronic program guide (EPG)display screen in the broadcast receiving device 100 in the embodiment.An EPG display screen 173 e is a delivery schedule table for thebroadcast programs in the digital broadcast service in the embodiment,the delivery schedule table being created by the main control unit 101on the basis of the program information data row which is output fromthe first separation unit 132. A program schedule key 741 a 7 in thebase screen 741 a for the cooperation control app may be selected todisplay the EPG display screen 173 e on the video display unit 173.

The EPG display screen 173 e, in a matrix form having a vertical of timedisplay and a horizontal of service ID (channel) display in theembodiment, displays detailed information about each program which is tobe broadcasted at each time zone on each channel. Detailed information173 e 1 about each broadcast program mainly includes a title area 173 e2 and a detailed explanation area 173 e 3 as shown in FIG. 16A.

The title area 173 e 2 displays a program title of each broadcastprogram and a symbol representing attribute of each broadcast program orthe like. Examples of the symbol representing attribute of eachbroadcast program or the like may include a mark obtained by symbolizing“New” which means a new program, and a mark obtained by symbolizing“Replay” which means a rebroadcasted program. Alternatively, a mark orthe like may be included which is obtained by symbolizing “data” whichmeans that the program is adapted to the data broadcasting by means ofthe broadcast service. Further, a mark or the like may be included whichis obtained by symbolizing “Linkage” which indicates that the broadcastprogram is provided with the broadcast cooperative app executable in thebroadcast receiving device 100 in the embodiment. The detailedexplanation area 173 e 3 displays associated information such as programcontent or cast members of each broadcast program, an URL of a homepageintroducing each broadcast program.

Note that the mark or the like obtained by symbolizing “Linkage” to bedisplayed in the title area 173 e 2 may not be necessarily displayed,even if the broadcast program is provided with the broadcast cooperativeapp, in a case where the execution in the broadcast receiving device 100is not enabled as a result of confirming the application profile 904.Moreover, the mark obtained by symbolizing “Linkage”, to be displayed inthe title area 173 e 2, which indicates that the broadcast program isprovided with the executable broadcast cooperative app may be furtherchanged in the color, shape, font, or the like depending on whether ornot the cooperative operation with the portable terminal device isenabled. In the case where the cooperative operation with the portableterminal device is enabled, a mark obtained by symbolizing “Mobile” maybe displayed together with the mark obtained by symbolizing “Linkage”.

Note that whether or not the mark obtained by symbolizing “Linkage” orthe mark obtained by symbolizing “Mobile” is displayed may be controlledthrough acquiring information, which is described in advance in the EITinformation including the detailed information about each broadcastprogram, such as whether or not each broadcast program is a broadcastprogram provided with a broadcast cooperative app executable in thebroadcast receiving device 100 in the embodiment, or whether or not theexecutable broadcast cooperative app is enabled to perform thecooperative operation with the portable terminal device. Alternatively,the information acquired from program delivery information about adigital broadcast program which is provided to a predetermined serverdevice over the Internet 200 may be added to the electronic programguide which is created on the basis of the program information data rowacquired from the broadcast wave of the digital broadcast service.

As described above, the mark obtained by symbolizing “Linkage” whichindicates that the broadcast program is provided with the executablebroadcast cooperative app or the mark obtained by symbolizing “Mobile”which indicates that the cooperative operation with the portableterminal device is enabled is displayed on the EPG display screen 173 e,such that the user can easily grasp an adaptation condition of eachbroadcast program with respect to the broadcast communicationcooperation service in the broadcast receiving device 100. Note that,needless to say, the mark obtained by symbolizing predeterminedcharacters representing the attribute of each broadcast program may bereplaced by the characters themselves, a sentence, or the like. Thebackground color of the detailed information 173 e 1 for each broadcastprogram may be changed to indicate the adaptation condition of eachbroadcast program with respect to the broadcast communicationcooperation service. Moreover, the mark obtained by symbolizing“Linkage”, the mark obtained by symbolizing “Mobile” or the like may benot usually displayed in the title area 173 e 2, but may pop up only ina case where each broadcast program is selected by a program selectioncursor 173 e 4.

The broadcast receiving device 100 in the embodiment has a function toperform video viewing reservation and/or video recording reservation foreach broadcast program on the EPG display screen 173 e. For example, ina state where the EPG display screen 173 e is displayed, the cursor key741 ac in the base screen 741 a for the cooperation control app is usedto move the program selection cursor 173 e 4 on the EPG display screen173 e and select any broadcast program using the enter key 741 ad, suchthat the video viewing reservation and/or video recording reservation ofthe selected broadcast program is performed.

In the above process, in a case where the broadcast program subjected tothe video viewing reservation and/or video recording reservation is abroadcast program adapted to the broadcast communication cooperationservice, the video viewing reservation and/or video recordingreservation may trigger initiating the acquisition of the broadcastcooperative app provided for the broadcast program without waiting for abroadcast start time of the broadcast program. In other words,information specifying a site for acquiring the broadcast cooperativeapp (location information such as the URL) may be described in the EITinformation including the detailed information for each broadcastprogram. By doing so, the broadcast receiving device 100 can grasp theinformation of the site for acquiring the broadcast cooperative appprovided for each broadcast program at the time when the broadcastprogram is selected by the program selection cursor 173 e 4. Therefore,the broadcast receiving device 100 may initiate the acquisition of thebroadcast cooperative app before the broadcast start time of thebroadcast program.

Note that in a case where the broadcast program subjected to the videoviewing reservation and/or video recording reservation is a broadcastprogram adapted to the broadcast communication cooperation service andis a broadcast program enabled to perform the cooperative operation withthe portable terminal device, the broadcast cooperative app (on theterminal side) provided for the portable terminal device may alsoinitiate the acquisition before the broadcast start time of thebroadcast program through the same process as the above. Further, asshown in FIG. 16B, a two-dimensional bar code 173 e 5 or the likeindicating the information of the site for acquiring the broadcastcooperative app (on the terminal side) (location information such as theURL) provided for the portable terminal device may be displayed on theEPG display screen 173 e to prompt the user to download the broadcastcooperative app (on the terminal side) provided for the portableterminal device.

In this way, the broadcast receiving device 100 may refer to theinformation of the site for acquiring the broadcast cooperative appincluded in the EPG information to initiate the acquisition of thebroadcast cooperative app before the broadcast start time of thebroadcast program, allowing the load on the service provider server 400storing the broadcast cooperative app to be distributed. Moreover, evenif a communication speed of the network between the service providerserver 400 and the broadcast receiving device 100 is insufficient, thebroadcast cooperative app can be effectively used from immediately afterstarting the broadcast of the broadcast program.

FIG. 17 is an operational sequence diagram showing an example of anacquisition sequence of the broadcast cooperative app in the case of thevideo viewing reservation and/or video recording reservation of thebroadcast program performed on the EPG display screen 173 e.

The main control unit 101 in the broadcast receiving device 100 acquiresthe program information data row output from the first separation unit132, during viewing the digital broadcast service (S701). If the useruses the operation terminal to make a request to run the EPG screen(S702), the EPG display screen 173 e is displayed on the video displayunit 173 (S703). If the user selects any broadcast program by use of theoperation terminal on the EPG display screen 173 e to perform the videoviewing reservation and/or video recording reservation of the broadcastprogram (S704), the main control unit 101 confirms the programinformation data row acquired from the first separation unit 132 (S705)and further confirms the location of the site for acquiring thebroadcast cooperative app which is linked to the broadcast programsubjected to the video viewing reservation and/or video recordingreservation (S706).

After the process at S706, the application control unit 161 sends arequest to send the broadcast cooperative app via the LAN communicationunit 121 to a predetermined service provider server 400 on the basis ofthe confirmed URL (S707). The service provider server 400 havingreceived the request to send the broadcast cooperative app performs, asneeded, the authentication process for the broadcast receiving device100 on the basis of the control by the applicationmanagement/distribution execution unit 4103, and thereafter, delivers apredetermined broadcast cooperative app stored in the applicationstorage area 4013 via the LAN communication unit 421 (S708).Subsequently, the application control unit 161 caches the predeterminedbroadcast cooperative app which is delivered from the service providerserver 400 and received via the LAN communication unit 121 in the RAM104 or the storage 110 (S709).

According to the broadcast receiving device 100 in the embodimentdescribed above, a further higher-value added function can be executed.

Embodiment 2

Hereinafter, a description is given of Embodiment 2 in the presentinvention. Note that the configurations and effects in the embodimentare the same as in Embodiment 1 unless otherwise specified. In thefollowing description, differences between the embodiment and Embodiment1 are mainly explained, and a description of the common points isomitted as much as possible in order to avoid the duplicateddescription.

A description is given further in detail of an embodiment aspect in thecase of the portable information terminal cooperative process(hereinafter, referred to as terminal cooperation), which is alsodescribed in Embodiment 1.

In the portable information terminal cooperation, there may be a casewhere availability of the terminal cooperation is desired to be limitedto only to the portable information terminal 700 in the same house asthe broadcast receiving device 100 (hereinafter, this limitation isreferred to as an in-same house limitation). For example, included are,for an application for using the broadcast cooperative (hereinafter,referred to as broadcast cooperative app), a case where the displayscreen of the broadcast receiving device 100 and the display screen ofthe portable information terminal 700 are closely associated with eachother, and a case where an advertising video displayed on the broadcastreceiving device 100 is required to be surely viewed by the user of theportable information terminal 700.

Note that a point to be considered as a procedure is determination onwhether or not a target broadcast cooperative app imposes in-same houselimitation. In a case where every broadcast cooperative app is assumedto impose the in-same house limitation, this determination isunnecessary, but in a case where no limitation may be imposed, thebroadcast receiving device 100 needs to acquire control informationregarding imposition of the in-same house limitation to change anoperation procedure. This control information regarding the limitationimposition may be acquired from the broadcast signal (e.g., which isdescribed as an item of the AIT) or acquired from a server specified bythe broadcast station.

Including the above procedure, a description is given in the embodimentof a procedure for securing that the portable information terminal 700exists in the same house as the broadcast receiving device 100.

Usually, devices existing in the same house exist on a local networkconnected to the same router device 210. Therefore, the portableinformation terminal 700 being connected to the same local network asthe broadcast receiving device 100 allows determination that they existin the same house. Note that whether or not a target device is connectedto the local network may be determined using a known method, thedescription thereof is omitted.

Moreover, even the portable information terminal 700 not existing on thelocal network may also be determined to exist in the same house throughdirectly communicating with the broadcast receiving device 100 by meansof the NFC, BlueTooth (registered trademark), or infrared communicationor the like. In this case, communication in order to acquire thebroadcast cooperative app or the like may be the above directcommunication or may be the mobile telephone communication.

A plurality of methods for confirming the existence in the same house asdescribe above can be considered, but which method is used is describedin the AIT and read out by the broadcast receiving device 100, forexample.

Further, a method may be used in which once the portable informationterminal 700 can be confirmed to exist in the same house, the existencein the same house is assumed until the program ends, or a method may beused in which a certain effective time period (e.g., ten minutes) isconsidered, and the existence in the same house is assumed within theeffective time period, but the existence in the same house is notassumed unless newly confirmed after expiration of the effective timeperiod. This effective time period is, for example, described in the AITand read out by the broadcast receiving device 100.

Further, a method may be used in which an event signal is set in thebroadcast signal at any time point during the course of the program, andevery time this event signal is received, the portable informationterminal 700 is confirmed to exist in the same house, for example.

Further, the two formers may be combined to be used.

Next, a description is given of a concrete procedure for permitting onlythe portable information terminal 700 existing in the same house to usethe terminal cooperation. In this embodiment, the limitation is imposedwhen the portable information terminal 700 acquires the broadcastcooperative app or acquires the information used in the broadcastcooperative app (hereinafter, the information used in the broadcastcooperative app and broadcast cooperative app, specifically the HTMLdocument, streaming video or the like, are collectively referred to asbroadcast cooperative information). There are two kinds of methods foracquiring the broadcast cooperative information, that is, communicationacquisition for acquiring from the broadcast station server 300 or theprovider server 400 and broadcast acquisition for acquiring from thebroadcast wave. In the case of the communication acquisition, there aretwo kinds, acquisition after initiating the broadcast receiving andacquisition before initiating the broadcast receiving. Further, in thecase of the communication acquisition, there are a case where once thebroadcast receiving device 100 acquires and the portable informationterminal 700 acquires from the broadcast receiving device 100, and acase where the portable information terminal 700 acquires directly fromthe broadcast station server 300 or the provider server 400. Variousmethods may be used, but, in terms of the portable information terminal700, the methods may be roughly divided into two cases of: acquisitionfrom the broadcast receiving device 100, and acquisition from thebroadcast station server 300 or the provider server 400.

In the embodiment, the case where the portable information terminal 700acquires the broadcast cooperative information from the broadcastreceiving device 100 is described, and the case of acquisition from theserver is described in the next embodiment.

FIG. 18A shows a procedure in the embodiment.

First, before the terminal cooperation, the portable informationterminal 700 and the broadcast receiving device 100 respectively are torun the cooperation control apps as an application for controlling theterminal cooperation (S10001, S10002). In this state, a request forterminal cooperation is made from the portable information terminal 700to the broadcast receiving device 100 (S10003). Next, the AIT isacquired from the broadcast signal (S10004). From the information ofthis AIT, whether or not an app for a target portable informationterminal imposes the in-same house limitation is determined (S10006), ifthe limitation is imposed, the process proceeds to a procedure atS10008, and then, proceeds to a step at S10009 in the first stage afterthe request for terminal cooperation is made, where determined iswhether or not the portable information terminal 700 having made therequest for terminal cooperation exists in the same house as thebroadcasting receiver 100 (S10009). As a result of the determination, ifno existence in the same house is determined, a response that thecooperation is not permitted is sent to the cooperation control app onthe portable information terminal side, and the process ends (S10011).

Here, in the first place, in the case where the terminal cooperativeapps all are assumed to impose the in-same house limitation, thedetermination at S10006 is skipped. In the case where there are both theapp imposing the in-same house limitation and the app not imposing, thedetermination at S10006 is made.

In the case where the portable information terminal 700 exists in thesame house, or the case where the app does not impose the in-same houselimitation, the process proceeds to S10012, and the broadcastcooperative app-associated service is executed. This service (S10012)deals with a request to deliver the broadcast cooperative informationfrom the portable information terminal 700 (S10013), and delivers thebroadcast cooperative information to the portable information terminal700 (S10018). This broadcast cooperative information includes thosedelivered from a delivery server received by the broadcast receivingdevice 100 (S10014, S10015, S10016), those acquired from the broadcastsignal (S10017), and those stored in the broadcast receiving device 100.The reception of the broadcast cooperative information by the broadcastreceiving device 100 (S10016, S10017) may include not only the casethrough the request to deliver the broadcast cooperative informationfrom the portable information terminal 700 (S10013), but alsoacquisition independently by the broadcast receiving device 100 oracquisition on the basis of an event occurrence from the broadcastsignal. Then, the delivery of the broadcast cooperative information tothe portable information terminal 700 (S10018) may also be performedindependently from the broadcast receiving device 100 side.

After a series of the reception (acquisition) and delivery of thebroadcast associated information is complete, whether or not thebroadcast receiving device 100 continues viewing the same program isdetermined (S10019), if not continues, a response that the cooperationis not permitted is sent to the cooperation control app on the portableinformation terminal side, and the process ends (S10020).

If the viewing in continued, the process returns to the procedure atS10005, and in a case where the in-house limitation is imposed, whetheror not the portable information terminal 700 exists in the same house(S10009), but whether or not a preset effective time period elapses fromthe last confirmation or whether a confirmation request (S10007) is madefrom the broadcast signal or delivery server after the last confirmationis determined (S10008), if neither is satisfied, the existence in thesame house is not confirmed (S10009) and the process proceeds throughS10010 to execution of the next broadcast cooperative app-associatedservice (S10012). Here, the confirmation request from the broadcastsignal (S10008) is depicted as being acquired from the broadcastcooperative information, but an event message is also depicted here asbeing included in the broadcast cooperative information. Further, thisconfirmation request may be described in the AIT.

Note that the above described procedure is a loop process procedure byall of the broadcast signal, the broadcast receiving device 100, theportable information terminal 700, and the delivery server in a zonerepresented by an arrow at S10022. The confirmation request at S10007may be made at any timing in the loop.

Further, the authentication information described in the AIT may beincorporated into an authentication key used for the authentication bythe delivery server (S10015). This allows confirmation of a rightauthentication request. Additionally, the authentication informationdescribed in the AIT may be changed as the program goes forward so as tonot perform the authentication by an authentication sever if theinformation synchronized with the course of the program is notincorporated into the authentication key, such that the viewing the sameprogram can be confirmed to be continued. In this case, the informationof the AIT may be appropriately read for update (S10021). Note that theauthentication information incorporated into the broadcast signal may bedescribed the AIT as well as incorporated as the broadcast cooperativeinformation. Further, as a method for substantially changing theauthentication information, a method may be used in which the URL itselfof the delivery server is changed as the program goes forward.

In this way, while executing the broadcast cooperative app-associatedservice (S10012), whether or not the portable information terminal 700exists in the same house as the broadcast receiving device 100 isconfirmed every preset effective time period, or every time theconfirmation request is made from the delivery server or broadcastsignal, which makes it possible to appropriately execute thebroadcast-associated app imposing the in-same house limitation. Further,using the authentication information incorporated into the broadcastsignal for the authentication by the delivery server allows validity ofthe delivery request to be ensured and the authentication information ofthe broadcast signal may be appropriately changed, such that the viewingthe same program can be also confirmed to be continued.

According to the portable information terminal cooperation technology inthe embodiment described above, the in-same house limitation can beachieved for the portable information terminal cooperative with thebroadcast receiving device.

Embodiment 3

In the embodiment, a description is given of the case where the portableinformation terminal 700 acquires the broadcast cooperative informationfrom the delivery server.

FIG. 18B shows a procedure in the embodiment.

First, before the terminal cooperation, the portable informationterminal 700 and the broadcast receiving device 100 respectively are torun the cooperation control apps as an application for controlling theterminal cooperation (S10101, S10102). In this state, a request forterminal cooperation is made from the portable information terminal 700to the broadcast receiving device 100 (S10103). Next, the AIT isacquired from the broadcast signal (S10104). The information regardingthe delivery server such as the URL is acquired from the information ofthis AIT to send the information to the portable information terminal700 (S10105). Next, a request to confirm the time is sent from thebroadcast receiving device 100 to the delivery server (S10106), and timeinformation is sent from the delivery server to the broadcast receivingdevice 100 on the basis of this request (S10107). This allowsauthentication key issuance (S10115) on time consistent with the time ofthe delivery server at a later stage, which may be omitted if a time lagis acceptable.

From the next stage, the process enters a loop control shown by an arrowat S10127.

First, a request to issue the authentication key or a request to deliverthe broadcast cooperative information is sent from the portableinformation terminal 700 to the broadcast receiving device 100 (S10109).The authentication key is used for a request to deliver the broadcastcooperative information sent to the delivery server at a later stage(S10125). A request to deliver the broadcast cooperative at S10109 is arequest to deliver the information acquired from the broadcast signal,and corresponds to a procedure at a later stage at S10126.

In either case, if the request at S10109 is made from the portableinformation terminal, whether or not the broadcast cooperative appimposes the in-same house limitation (S10111), if the limitation isimposed, the process proceeds to the next procedure S10112, or if nolimitation is imposed, the procedure at S10112 is skipped and theprocess proceeds to S10114. In the case where all the broadcastcooperative apps impose the in-same house limitation, the determinationat S10111 is not made and the process proceeds to S10112. At S10112,whether or not the portable information terminal making the requestexists in the same house, and if not exist, the terminal cooperation isended (S10113). If exists in the same house, the requested procedure,the acquisition of the broadcast cooperative information from thedelivery server (S10125), or the acquisition of the broadcastcooperative information from the broadcast signal is performed (S10126).Besides the acquisition from the delivery server, the acquisition fromthe broadcast signal may be performed, and thus, the procedure at S10126is depicted.

First, a description is given of the acquisition procedure (S10125) ofthe broadcast cooperative information from the delivery server.

Firstly, the authentication key requested from an portable informationterminal 700 is issued from the broadcasting receiver 100. At this time,the authentication key may be valid within a predetermined time period(e.g., for ten minutes) including the time information at the issuancetime. The delivery server confirms the authentication informationincluding whether or not the authentication key is within the effectivetime period, and permits the broadcast cooperative information to bedelivered if the authentication is OK. After this, the information ispermitted to be delivered within the effective time period, but thedelivery is stopped when the effective time period expires. For example,the streaming video may not be viewed after the effective time periodexpires.

The preset effective time period may be preserved by the delivery serveror may be acquired from the broadcast signal (e.g., the AIT) by thebroadcast receiving device 100 to incorporate the effective time periodinformation into the authentication key. To the portable informationterminal 700, the effective time period information is notified inadvance and the request to issue the authentication key is sent beforeexpiration of the effective time period. Alternatively, the effectivetime period is managed by the broadcast receiving device 100, and beforeexpiration of the effective time period, the portable informationterminal 700 is confirmed to exist in the same house, and then, theauthentication key may be automatically issued from the broadcastreceiving device 100 to the portable information terminal 700.

The effective time period may be the same in one program, and may bevaried in time with the program going forward. Moreover, if no effectivetime period is set, the authentication may be dealt with to be validduring viewing the program after the authentication is performed onetime.

Further, the authentication information described in the AIT may beincorporated into the authentication key used for the authentication bythe delivery server (S10117). This allows confirmation of the validauthentication request. Additionally, the authentication informationdescribed in the AIT may be changed as the program goes forward so as tonot perform the authentication by the authentication server if theinformation synchronized with the course of the program is notincorporated into the authentication key, such that the viewing the sameprogram can be confirmed to be continued. In this case, the informationof the AIT may be appropriately read for update (S10124). Note that theauthentication information incorporated into the broadcast signal may bedescribed the AIT as well as incorporated as the broadcast cooperativeinformation. Further, as a method for substantially changing theauthentication information, a method may be used in which the URL itselfof the delivery server is changed as the program goes forward. Note thatthe URL change in this case is in a case where the delivery server isidentical and an entry is different, but the delivery server may bechanged to a new delivery server due to change of the broadcastcooperative app or the like. In this case, every time changing, theprocedures of the delivery server information sending (S10105), the timeconfirmation requesting (S10106), and the time information sending(S10107) are performed.

Next, a description is given of a procedure for acquiring the broadcastcooperative information from the broadcast signal (S10126).

In this case, after confirming that the portable information terminal700 exists in the same house, the broadcast receiving device 100acquires the broadcast cooperative information from the broadcast signal(S10119), and subsequently, delivers that information to the portableinformation terminal 700 (S10120).

Note that in the case where the broadcast cooperative information ischanged as the program goes forward, a change notification may be sentfrom the broadcast signal (S10110), and the notification is used as atrigger so that the broadcast cooperative information may be acquired insome cases. In that case, if the acquisition is from the deliveryserver, the authentication key is issued from the broadcast receivingdevice 100 to the portable information terminal (S10115) to notify ofthe change notification. Within the effective time period, the issuanceof the authentication key may be omitted even only with the changenotification being notified. In the case of the acquisition from thebroadcast signal, the broadcast receiving device 100 acquires theinformation (S10119) to deliver to the portable information terminal(S10120). Note that in the case of the acquisition from the broadcastsignal, the portable information terminal 700 may be confirmed to existin the same house, every time notifying the change notification, or theconfirmation may be omitted within the effective time period as inEmbodiment 2. Here, the change notification from the broadcast signal(S10110) is depicted as being acquired from the broadcast cooperativeinformation, but an event message is also depicted here as beingincluded in the broadcast cooperative information. Further, this changenotification may be described in the AIT.

After a series of the reception (acquisition) and delivery of thebroadcast associated information is complete, whether or not thebroadcast receiving device 100 continues viewing the same program isdetermined (S10121), if not continues, a response that the cooperationis not permitted is sent to the cooperation control app on the portableinformation terminal side, and the process ends (S10123). If the viewingis continued, the process returns to S10108 to continue the loop processS10127.

In this way, the time information is included in the authentication keyused for authenticating the delivery server and the effective timeperiod is managed, such that the portable information terminal 700 canbe periodically confirmed to exist in the same house as the broadcastreceiving device 100, which makes it possible to appropriately executethe broadcast-associated app imposing the in-same house limitation.Further, using the authentication information incorporated into thebroadcast signal for the authentication by the delivery server allowsvalidity of the delivery request to be ensured and the authenticationinformation of the broadcast signal may be appropriately changed, suchthat the viewing the same program can be also confirmed to be continued.

According to the portable information terminal cooperation technology inthe embodiment described above, the in-same house limitation can beachieved even in the case where the portable information terminalcooperative with the broadcast receiving device acquires the broadcastcooperative information from the delivery server.

Embodiment 4

Embodiments 2 and 3 describe the procedure for achieving the in-samehouse limitation in the terminal cooperation, but usage from outside thehouse may be permitted depending on the broadcast cooperative app. Sucha case is described in the embodiment. For example, a case where theprogram itself is press-agenting and advertising like a home shopping,it is preferable also for a broadcast provider that the broadcastcooperative app can be used regardless of whether in the same house oroutside the house. In the case like this, if registration is made in thebroadcast receiving device 100 one time, the usage of the broadcastcooperative app may be permitted regardless of whether or not theportable information terminal 700 is in the house. In this case, thebroadcast cooperative app in which the broadcast video itself is handledas streaming data to deliver from the broadcast receiving device 100 viathe Internet to the portable information terminal 700 may furtherimprove the convenience. The streaming data may be encrypted in thebroadcast receiving device 100 for the purpose of copyright protection.Whether or not the broadcast cooperative app permits the usage fromoutside the house, including the delivery of the broadcast video tooutside the house, is described in the data within broadcast signal(e.g., AIT).

FIG. 18C shows a concrete procedure. This procedure is partially commonwith those in Embodiments 2 and 3, and a description of the duplicatedpart of Embodiments 2 and 3 is omitted. The broadcast receiving device100 when receiving the request for terminal cooperation from outside thehouse (S10203), if the app permitted to be used outside the house,confirms that the requesting terminal is the already registered portableinformation terminal (S10205) before permitting the cooperation. Here,both the portable information terminal 700 and the broadcast receivingdevice 100 may perform the authentication (S10207), as needed, for thepurpose of copyright protection for the broadcast video and thebroadcast cooperative information. At that occasion, the relevantauthentication may be an authentication in the authentication server(S10207). Information on whether or not the copyright protection isrequired and information on an authentication method of the copyrightprotection are acquired from the broadcast signal (the information maybe described in the AIT, for example), depending on which informationthe control is performed. In a case where the above information is notstored in the broadcast signal, a predetermined method defined inadvance in the broadcast receiving device 100 is complied with. Forexample, a predetermined copyright protection process defined in advancemay be performed. Moreover, in the case where the above information isnot stored in the broadcast signal, a definition that the copyrightprotection process is not performed may be made in advance in thebroadcast receiving device 100.

Concrete examples (1) to (4) of the authentication for the purpose ofcopyright protection are shown as below. Only one of the authenticationsbelow may be performed. Alternatively, a combination of the pluralauthentications shown below may be performed. Further, a combination ofthe authentication illustrated below and another authentication processnot illustrated below may be performed.

(1) Authentication using ID and Password

An ID and a password are issued when the portable information terminal700 is registered on the broadcast receiving device 100, and thebroadcast receiving device 100 confirms these ID and password to permitthe cooperation.

(2) Using Encryption Key

In addition to the above authentication using the ID and the password,an encryption key for decrypting encrypted video data or the like issent from the broadcast receiving device 100 to the portable informationterminal. This encryption key may be acquired from the broadcast signal(the key is described in the AIT, for example).

(3) Utilizing Authentication Server

A method for issuing from the authentication server the encryption keyfor decrypting the encrypted video data or the like. The portableinformation terminal 700 sends the ID and the password to theauthentication server to acquire the encryption key. In this case, thelocation information of the authentication server (specifically, theURL) is acquired from the broadcast signal (the information is describedin the AIT, for example), and this location information is sent from thebroadcast receiving device 100 to the portable information terminal 700,further heightening safety. If the portable information terminal 700cannot decrypt the video or the like in a case of unavailability of theencryption key, requesting the authentication in the authenticationserver from the broadcast receiving device 100 may be handled as theauthentication of the copyright protection, or the authentication may becompleted through a notification of the encryption key acquisition, sentfrom the portable information terminal 700 to the broadcast receivingdevice 100. Note that billing may be made by the authentication server.

(4) Encryption Key Mutual Authentication

The broadcast receiving device 100 and the portable information terminal700 authenticate and confirm their respective encryption keys with eachother to authenticate the copyright protection.

In a case where the information stored in the broadcast signal indicatesnecessity for the copyright protection by a predetermined method, if thecopyright protection cannot be authenticated by the predeterminedmethod, the terminal cooperation is not permitted. Additionally, even ina case where the authentication is performed by a method predefined inthe broadcasting receiver 100 because the information is not specifiedin the broadcast signal, if the authentication of the copyrightprotection cannot be performed by the relevant predefined method, theterminal cooperation is not permitted.

In the case where the terminal cooperation is permitted, after this,whether or not the portable information terminal 700 exists in the samehouse is not confirmed, and the broadcast cooperative information isdelivered (S10217) and the authentication key for the delivery server isissued (S10212) with respect to the portable information terminal 700 inresponse to a request from the portable information terminal 700(S10211), an independent control by the broadcast receiving device 100,and a request from the broadcast signal (S10210). Note that, in thiscase, the control in which the effective time period is set may not beperformed. The portable information terminal 700 outside the house usesthe broadcast receiving device 100 or the issued authentication key toacquire the broadcast cooperative information from the delivery server(S10215). In addition, the authentication information acquired from thebroadcast signal (the information may be described in the AIT, forexample) may be incorporated into the authentication key issued by thebroadcast receiving device 100, and the delivery server may permitaccess if the authentication key has the authentication informationincorporated therein which is acquired from the broadcast signal,allowing the further appropriate usage outside the house.

Further, in a case where a discount is made as a premium on the programviewing or the like, there is a case where the broadcast cooperative appmay not be unlimitedly permitted to be used, and in such case, it ispreferable that the authentication is performed one time with theportable information terminal existing in the same house, andthereafter, the delivery server is permitted to be used with even theterminal not existing in the same house. In this case, the portableinformation terminal 700 may not be registered on the broadcastreceiving device 100.

FIG. 18D shows a concrete procedure in this case. The relevant procedureis partially common with those shown in FIG. 18C, and a description ofthe duplicated part is omitted. First, in a state where the portableinformation terminal 700 exists in the same house as the broadcastreceiving device 100, a request for terminal cooperation is made fromthe portable information terminal 700 to the broadcast receiving device100, and the broadcast receiving device 100 confirms that the relevantportable information terminal 700 exists in the same house (S10305)before permitting the cooperation. Here, both the portable informationterminal 700 and the broadcast receiving device 100 may perform theauthentication (S10307), as needed, for the purpose of copyrightprotection for the broadcast video and the broadcast cooperativeinformation. At that occasion, the relevant authentication may be anauthentication in an external authentication server. Information onwhether or not the copyright protection is required and information onan authentication method of the copyright protection are acquired fromthe broadcast signal (the information may be described in the AIT, forexample), depending on which information the control is performed. In acase where the above information is not stored in the broadcast signal,a predetermined method defined in advance in the broadcast receivingdevice 100 is complied with. For example, a predetermined copyrightprotection process defined in advance may be performed. Moreover, in thecase where the above information is not stored in the broadcast signal,a definition that the copyright protection process is not performed maybe made in advance in the broadcast receiving device 100.

Concrete examples (5) to (7) of the authentication for the purpose ofcopyright protection are shown as below. Only one of the authenticationsbelow may be performed. Alternatively, a combination of the pluralauthentications shown below may be performed. Further, a combination ofthe authentication illustrated below and another authentication processnot illustrated below may be performed.

(5) Using Encryption Key

In a state where the portable information terminal 700 exists in thesame house, an encryption key for decrypting encrypted video data or thelike is sent from the broadcast receiving device 100 to the portableinformation terminal. This encryption key may be acquired from thebroadcast signal (the key is described in the AIT, for example).Handover of this encryption key in the same house is dealt with as theauthentication. Further, the encryption key may not be acquired from thebroadcast signal except at a time point of the program, and the handoverof the encryption key to the portable information terminal 700 may belimited to in the same house, such that a limitation that the terminalhas to exist in the same house at that time point can be put, which mayalso be used for the premium on the program viewing.

(6) Utilizing Authentication Server

A method for issuing from the authentication server the encryption keyfor decrypting the encrypted video data or the like. The portableinformation terminal 700 sends the ID and the password to theauthentication server to acquire the encryption key. In this case, thelocation information of the authentication server (specifically, theURL) is acquired from the broadcast signal (the information is describedin the AIT, for example), and this location information is sent from thebroadcast receiving device 100 to the portable information terminal 700,further heightening safety. If the portable information terminal 700cannot decrypt the video or the like in a case of unavailability of theencryption key, requesting the authentication in the authenticationserver from the broadcast receiving device 100 may be handled as theauthentication of the copyright protection, or the authentication may becompleted through a notification of the encryption key acquisition, sentfrom the portable information terminal 700 to the broadcast receivingdevice 100. Access to the authentication server may be made in the samehouse or outside the house, but the location information of theauthentication server may not be acquired from the broadcast signalexcept at a time point of the program, and the handover of the locationinformation to the portable information terminal 700 may be limited toin the same house, such that a limitation that the terminal has to existin the same house at that time point can be put, which may also be usedfor the premium on the program viewing. Note that billing may be made bythe authentication server.

(7) Encryption Key Mutual Authentication

The broadcast receiving device 100 and the portable information terminal700 authenticate and confirm their respective encryption keys with eachother to authenticate the copyright protection. This authentication mayalso be performed in the same house or outside the house.

In a case where the information stored in the broadcast signal indicatesnecessity for the copyright protection by a predetermined method, if thecopyright protection cannot be authenticated by the predeterminedmethod, the terminal cooperation is not permitted. Additionally, even ina case where the authentication is performed by a method predefined inthe broadcasting receiver 100 because the information is not specifiedin the broadcast signal, if the authentication of the copyrightprotection cannot be performed by the relevant predefined method, theterminal cooperation is not permitted. The procedures after the terminalcooperation is permitted is common with the procedures in FIG. 18C, andthus, the description thereof is omitted.

According to the portable information terminal cooperation technology inthe embodiment described above, the usage from outside the house withthe copyright protection being considered can be achieved for theportable information terminal cooperative with the broadcast receivingdevice.

Embodiment 5

Under an actual usage condition, it is further preferable to easilyperceive whether or not the terminal cooperative app is presentdepending on the program and which terminal cooperative app can beavailable. In the embodiment, a description is given of a method fordisplaying a usage availability condition of the terminal cooperativeapp.

FIG. 19A is an example of a launcher screen (173 b 11) for the broadcastcooperative app in a case where the terminal cooperative app is present.The broadcast cooperative app is displayed by a framed character icon.Broadcast cooperative apps (173 b 12 to 173 b 14) for the broadcastreceiving device 100 cooperative with the program which is being viewedand broadcast cooperative apps (173 b 15 to 173 b 17) for the portableinformation terminal are displayed. In the case of this example, aborder thickness of a frame surrounding a character string and a colorinside the frame indicate a condition of the app. The main body apps Aand B (173 b 12, 173 b 13) and the terminal apps A and B (173 b 15, 173b 16) are in a state of being available, and the main body app C (173 b14) and the terminal app C (173 b 17) are in a state of beingunavailable. The state in which the terminal app is unavailable meansthat there is no portable information terminal 700 having a function toexecute the relevant app among those which are in a state communicablewith the broadcast receiving device 100.

FIG. 19B is a screen after the terminal app A is selected in FIG. 19A. Astate of each portable information terminal 700 relating to the terminalapp A is indicated. The portable information terminal displayed in thisscreen is a terminal which was cooperative with or registered on thebroadcast receiving device 100 at an earlier time.

A portable terminal 1 (173 b 22) and portable terminal 2 (173 b 23)having the frame border of the icon of solid line are shown to be in thestate communicable with the broadcast receiving device 100, and aportable terminal 3 (173 b 24) and portable terminal 4 (173 b 25) havingthe frame border of dotted line are shown not to be in the statecommunicable with the broadcast receiving device 100. Moreover, aportable terminal 1 (173 b 22) and portable terminal 3 (173 b 24) havingthe color inside the icon frame of white are shown to have the functionto execute the terminal app A, and a portable terminal 2 (173 b 23) andportable terminal 4 (173 b 25) having the color inside the frame of grayare shown not to have the function to execute the terminal app A.Further, in a case where the app has already been being executed in therelevant terminal, an icon designed so as to indicate this condition maybe used.

Additionally, the icon having a picture depicted is visually distinct,whose example is shown next.

FIG. 19C is an example of a launcher screen (173 b 31) showing a list ofthe broadcast cooperative apps. Besides the broadcast receiving device100, icons are illustrated for each type of the portable informationterminal 700. Reference signs 173 b 32 and 173 b 33 designate the iconsrepresenting the broadcast receiving device 100, reference signs 173 b34 and 173 b 35 designate the icons representing the portableinformation terminal 700 of a smartphone type, and a reference sign 173b 36 designates the icon representing the portable information terminal700 of a head-mounted display type. Each app is dedicated for a devicerepresented by the icon.

In FIG. 19C, in a case where the relevant app is not available, a markrepresenting unavailability (the mark of circle with an oblique line inthis case) is displayed to overlap a picture of the device. Moreover, asfor the broadcast receiving device 100, in the case where the relevantapp has already been being executed, a mark indicating this condition(the mark of circle with a point) may be displayed to overlap. Thisdisplay can prevent an operation in which the procedure of the launcheris progressed in vain although the execution has already been beingdone. In the case of the portable information terminal 700, a methodalso can be performed in which a mark indicative of being executed isdisplayed when the relevant app is being executed in the all terminalswhich are in the state communicable with the broadcast receiving deviceand can execute the relevant app.

FIG. 19D is a screen (173 b 41) after the app C (173 b 34) is selectedin FIG. 19C. The state of the portable information terminal 700 of atype corresponding to the app C is displayed. In this screen, in thecases where the portable information terminal 700 does not have thefunction to execute the broadcast cooperative app, is not in the statecommunicable with the broadcast receiving device 100, and has alreadybeen executing the relevant broadcast cooperative app, a mark indicatingeach of the respective conditions is displayed to overlap the icon. Inthis example, the marks (173 b 44, 173 b 46) of circle with an obliqueline are displayed in the case of no execution function, the marks (173b 45, 173 b 46) of triangle with an exclamation mark are displayed inthe case of the non-communicable state, and the mark (173 b 43) ofcircle with a point is displayed in the case of already being executing.

Further, a display method is desirable which makes the presence of thebroadcast cooperative app perceived when the condition varies even ifthe launcher does not run point by point. For example, in turning on thepower, in changing the channel, at the beginning of the program, inchanging the broadcast cooperative app even in the middle of theprogram, in changing the communication state between the broadcastreceiving device 100 and the portable information terminal 700, and inchanging an execution condition of the app, the icon is displayed onlyfor a predetermined time period to display the state at that time.

FIG. 19E shows an example of those cases. The icon indicating the typeof each device being displayed represents that the broadcast cooperativeapp corresponding to the device of that type is present. In this case,the mark of circle with an oblique line represents that no one ofdevices of that type in the state of being available can execute therelevant app. The mark of circle with a point represents that alldevices of that type in the state of being available are executing therelevant app.

FIG. 19F is a display screen (10401) in the portable informationterminal 700. It may be convenient for usage that which broadcastcooperative app is available to which broadcast receiving device 100 isperceived from a list when the portable information terminal 700requests the terminal cooperation. FIG. 19F shows an example of the list(10402). This table represents that which broadcast receiving device 100in the user's house the broadcast cooperative app corresponding to theprogram desired to be found is available to. Moreover, the state of eachbroadcast receiving device 100 also being displayed may improve theconvenience particularly in using outside the house. In this example,displayed examples are shown such as during receiving the relevantprogram, during receiving another program, vacant, and another programreserved (a case of video recording reservation of another program inthe middle of the program). Here, note that in a case where thebroadcast receiving device 100 has therein a plurality of tuners, thestate being displayed for each of the plurality of tuners furtherdifferentiates the convenience. The tuners in the same device aredistinguished by a branch number in a table 10402. For example, areceiving device B-1 and a receiving device B-2 are the tuners in thesame broadcast receiving device 100. In the case of the terminalcooperation, a video unit in the broadcast receiving device 100 is notrequired to be used so long as the delivery of the broadcast video andaudio as the streaming data can be received, and the broadcast isavailable so long as the tuner in the broadcast receiving device 100 canbe used, it may be convenient that the usage condition for each tuner isperceived.

Note that in order to perform the displaying descried in the embodiment,information on whether or not an app corresponds to the broadcastreceiving device 100 or which type of the portable information terminal700 an app corresponds to is required for each broadcast cooperativeapp. Moreover, information for executing the corresponding app in thebroadcast receiving device 100 or the portable information terminal 700is required. The above information may be described in the AIT, forexample, such that the information receiving device 100 can acquire theinformation.

According to the portable information terminal cooperation technology inthe embodiment described above, displaying the information regarding thebroadcast cooperative app, the broadcast receiving device 100, and theportable information terminal 700 allows the further convenientbroadcast cooperative service to be used.

Embodiment 6

Hereinafter, a description is given of Embodiment 6 in the presentinvention. Note that the configurations and effects in the embodimentare the same as in Embodiment 1 unless otherwise specified. In thefollowing description, differences between the embodiment and Embodiment1 are mainly explained, and a description of the common points isomitted as much as possible in order to avoid the duplicateddescription.

Generally, in a case of a broadcast program involving a strenuous motionsuch as sports relay broadcasting, the television using a liquid crystalpanel or the like driven at 60 Hz for the video display unit has aproblem that an afterimage is generated in viewing. In order to reducethis afterimage, there have been available many televisions havingmounted in the video display unit a liquid crystal panel capable ofbeing driven at 120 Hz. In addition, technologies have been devised assignal processing corresponding to driving the video display unit at 120Hz, in which, for example, (A) a video of 120 Hz is generated byinserting a black video frame between individual frames of a video of 60Hz, (B) a video of 120 Hz is generated through frame interpolationsignal processing in which motion information is calculated from adifference in a video having continuous frames of a video of 60 Hz tocreate an intermediate video frame on the basis of the calculated motioninformation.

However, in the case of the technology (A) above, the signal processingof creating the black video frame is easy, but disadvantageously abrightness feeling for the video deteriorates, screen flicker occurs,and so on. On the other hand, in the case of the technology (B), thebrightness degradation or the screen flicker occurrence can besuppressed, but the signal processing of creating the intermediate videoframe from the continuous frames of the video is difficult, anddisadvantageously a big noise may be generated depending on content thevideo, and so on.

As the most effective means for solving the above problem, the broadcastprogram created at a frame rate of 120 Hz by the broadcast station maybe sent out by way of the broadcast wave, and the television havingmounted therein the liquid crystal panel capable of being driven at 120Hz may receive and display the broadcast wave of the broadcast programcreated at 120 Hz. By doing so, the problems concerning the technology(A) or (B) can be prevented from occurring. However, the currentavailable television is based on the assumption of receiving thebroadcast wave of the broadcast program created at the frame rate of 60Hz, and in a case where the broadcast program created at the frame rateof 120 Hz by the broadcast station is sent out by way of the broadcastwave, a problem may occur in terms of compatibility with an olderproduct.

In the embodiment, a description is given of the broadcast receivingdevice capable of displaying the high-quality picture video informationwith the problems described above being solved.

FIG. 20A is a block diagram showing an example of an internalconfiguration of a broadcast receiving device 100 i in the embodiment.The broadcast receiving device 100 i in the embodiment has aconfiguration basically the same as the broadcast receiving device 100in Embodiment 1, but a video interpolation/superimposition unit 171 i isprovided in place of the video superimposition unit 171. The videointerpolation/superimposition unit 171 i may include, in addition to thefunction of the video superimposition unit 171, a function to subject avideo information of the frame rate of 60 Hz output from the first videodecoding unit 133 to a predetermined signal processing so as to generatea video information of the frame rate of 120 Hz. Moreover, the videodisplay unit 173 may be a display device capable of being driven atleast at 120 Hz such as a liquid crystal panel.

FIG. 20B is an example of a software configuration diagram of thebroadcast receiving device 100 i in the embodiment, and shows aconfiguration of software in the ROM 103, the RAM 104, and the storageunit 110. A software configuration of the broadcast receiving device 100i in the embodiment is basically the same as the software configurationof the broadcast receiving device 100 in Embodiment 1, but when thereceiving function program 1002 stored in the storage unit 110 isexpanded on the RAM 104, there are configured the broadcast programreproduction unit 1102 a, the communication content reproduction unit1102 b, the cooperative app control unit 1102 c, and the terminalcooperation management unit 1102 d as well as an interpolation signalprocessing unit 1102 i. The interpolation signal processing unit 1102 icontrols the function of the interpolation signal processing of thevideo interpolation/superimposition unit 171 i, in particular, ofconverting the video information of the frame rate of 60 Hz output fromthe first video decoding unit 133 into the video information of theframe rate of 120 Hz.

A description is given of an example of an outline of an operation fordisplaying the video information of the broadcast program at the framerate of 120 Hz created by the broadcast station on the video displayunit 173 in the broadcast receiving device 100 i in the broadcastreceiving device 100 i in the embodiment with reference to FIG. 21A andFIG. 21B.

FIG. 21A is a conceptual diagram illustrating an example of an outlineof the signal processing (on the broadcast station side) in thecommunication system including the broadcast receiving device 100 i inthe embodiment.

A video information 801 which is the video information of the broadcastprogram created at the frame rate of 120 Hz by the broadcast stationincludes video frames F00, F01, F02, F03, F04, F05, and thosesubsequent. Needless to say, the video information 801 has 120 videoframes per second. The broadcast station does not subject the videoinformation 801 as itself to encoding or the like, but first,alternately extracts 60 video frames from 120 video frames per second tocreate video information 802 of the frame rate of 60 Hz. The videoinformation 802 includes video frames F00, F02, F04, and thosesubsequent. The broadcast station subjects the created video information802 of the frame rate of 60 Hz to the processing such as encoding,superimposition with respect to various pieces of information, andmodulation to be sent out from the radio tower 300 t. Note that thebroadcast wave sent out from the radio tower 300 t may be also receivedby and displayed on the older television not corresponding to the videoinformation of the frame rate of 120 Hz.

On the other hand, video information 803 including the video frames F01,F03, F05, and those subsequent are packaged together with the timeinformation to be made into the additional data. Further, the packagedadditional data is sent from the broadcast station server 300 to theservice provider server 400, and stored in the moving picture contentstorage area 4011 of the storage unit 410. In a case where the packagedadditional data has accompanying information, the accompanyinginformation is stored in the metadata storage area 4012.

FIG. 21B is a conceptual diagram illustrating an example of an outlineof the signal processing (on the broadcast receiving device) in thecommunication system including the broadcast receiving device 100 i inthe embodiment.

The broadcast receiving device 100 i subjects the broadcast wavereceived via the antenna 100 a to a channel selection/demodulationprocess in the tuner/demodulation unit 131 to output video information811 of the frame rate of 60 Hz from the first video decoding unit 133.Further, the video information 811 is input to the videointerpolation/superimposition unit 171 i. On the other hand, videoinformation 814 obtained by expanding the packaged additional data whichis acquired from the service provider server 400 via the LANcommunication unit 121 is also input to the videointerpolation/superimposition unit 171 i.

The video interpolation/superimposition unit 171 i refers to PCRinformation concerning the video information 811, time informationconcerning video information 814, system clock information of thebroadcast receiving device 100 i, and the like on the basis of thecontrol by the interpolation signal processing unit 1102 i whileperforming interpolation signal processing 815 of inserting respectivevideo frames of the video information 814 between respective videoframes of the video information 811. For example, the video frame F01 ofthe video information 814 is inserted between the video frames F00 andF02 of the video information 811 and the video frame F03 of the videoinformation 814 is inserted between the video frames F02 and F04 of thevideo information 811 on the basis of the PCR information, the timeinformation and the like. As a result, video information 816 of theframe rate of 120 Hz is created. The video information 816 is furtherappropriately subjected to the signal processing by the videointerpolation/superimposition unit 171 i and provided to the user by thevideo display unit 173.

According to the signal processing in the communication system describedabove, the compatibility with the older television is maintained whilethe easy interpolation signal processing can reproduce the videoinformation of the frame rate of 120 Hz, and additionally can performvideo displaying with no brightness feeling deterioration, screenflicker and big noise occurring in the broadcast receiving device 100 iin the present invention.

FIG. 22 is an operational sequence diagram illustrating in more detailthe operation of the broadcast receiving device 100 i illustrated inFIG. 21B.

If the tuner/demodulation unit 131 in the broadcast receiving device 100i performs a process for selecting a channel desired by the user toacquire the TS, then, the main control unit 101 acquires a PMT data rowseparated by the first separation unit 132 (S20001), and confirms therunning priority described in the PMT. In the process at S20001, if therunning priority of the broadcast cooperative app is confirmed to behigher (S20002), then, the application control unit 161 acquires an AITdata row separated by the first separation unit 132 (S20003), andconfirms the application control code 903 of the acquired AIT data row(S20004). In a case where the application control code 903 is “automaticrun” in the process at S20004, the application profile 904 of theacquired AIT data row is further confirmed (S20005), and in a case wherethe execution of the broadcast cooperative app specified in the AIT isconfirmed to be enabled, in particular, in a case where execution of theinterpolation signal processing in the videointerpolation/superimposition unit 171 i is confirmed to be enabled, arequest to send the broadcast cooperative app (interpolation control) issent via the LAN communication unit 121 to a predetermined serviceprovider server 400 on the basis of the information described in theapplication-acquired site information 905 (S20006).

The service provider server 400 having received the request to send thebroadcast cooperative app (interpolation control) performs, as needed,the authentication process for the broadcast receiving device 100 i onthe basis of the control by the application management/distributionexecution unit 4103, and thereafter, delivers the broadcast cooperativeapp (interpolation control) stored in the application storage area 4013via the LAN communication unit 421 (S20007). Note that theauthentication process may be performed using a known method, and adetailed description thereof is omitted. Next, the application engine162 in the broadcast receiving device 100 i runs the broadcastcooperative app (interpolation control) which is delivered from theservice provider server 400 and received via the LAN communication unit121 on the basis of the control by the application control unit 161(S20008).

The broadcast cooperative app (interpolation control) run at S20008,then, sends a request to deliver the packaged additional data via theLAN communication unit 121 to a predetermined service provider server400 (S20009). The service provider server 400 having received therequest to send the packaged additional data delivers the packagedadditional data stored in the moving picture content storage area 4011via the LAN communication unit 421 on the basis of the control by theapplication management/distribution execution unit 4103 (S20010). Next,the broadcast cooperative app (interpolation control) expands thepackaged additional data received via the LAN communication unit 121,and further outputs the video information 814 acquired through theexpanding process to the video interpolation/superimposition unit 171 i.

The video information 811 of the broadcast program output from the firstvideo decoding unit 133 is also input to the videointerpolation/superimposition unit 171 i (S20011). The videointerpolation/superimposition unit 171 i refers to the PCR informationoutput from the first separation unit 132, the time informationconcerning the video information 814, the system clock information ofthe broadcast receiving device 100 i, and the like on the basis of thecontrol by the interpolation signal processing unit 1102 i whileperforming interpolation signal processing 815 of inserting therespective video frames of the video information 814 between therespective video frames of the video information 811 (S20012).

Note that the interpolation signal processing 815 is repeated until anevent occurs such as end of the broadcast program, change of thechannel, and power-off of the broadcast receiving device 100 i (S20013).In the case of the above event or the like occurs, the broadcastcooperative app (interpolation control) sends a request to stopdelivering the packaged additional data via the LAN communication unit121 to a predetermined service provider server 400 (S20014). Then, thebroadcast cooperative app (interpolation control) ends its operation(S20015).

The above processes allow providing the higher-value added broadcastreceiving device capable of displaying the video information withreduced afterimage on the communication system in which thecompatibility with the older product is maintained also in the case ofthe broadcast program involving a strenuous motion such as sports relaybroadcasting.

Note that the broadcast cooperative app (interpolation control) mayinclude the packaged additional data. In this case, the above describedprocesses at S20009, S20010, S20014, and the like are not required.

In addition, the video interpolation/superimposition unit 171 i mayfurther have the function (A) to generate a video of 120 Hz by insertinga black video frame between individual frames of a video of 60 Hz, or(B) to generate a video of 120 Hz through frame interpolation signalprocessing in which motion information is calculated from a differencein a video having continuous frames of a video of 60 Hz to create anintermediate video frame on the basis of the calculated motioninformation, and the like as described above. By doing so, even in casewhere a network traffic is congested between the broadcast receivingdevice 100 i and the service provider server 400 to cause the additionaldata to fail to be acquired in time and so on, the above process (A) or(B) may allow the video of 120 Hz to continue to be displayed. Forexample, in a case where the main control unit 101 may monitor acommunication condition of the LAN communication unit 121, when theadditional data fails to be acquired in time, possibly fails, or thelike, the interpolation signal processing in the videointerpolation/superimposition unit 171 i may be switched from theprocess described in FIG. 21B to the process (A) or (B).

In addition, as is described in Embodiment 1, the acquisition of theadditional data may be initiated without waiting for the broadcast starttime of the broadcast program, and further the acquisition may becompleted. In this case, the concern is eliminated that the networktraffic congestion between the broadcast receiving device 100 i and theservice provider server 400 causes to the additional data to fail to beacquired in time. Note that in this case, the broadcast receiving device100 i can access the additional data before the broadcast start time ofthe broadcast program. For this reason, the additional data ispreferably in a state of being encrypted. Moreover, in this case, in theprocess at S20003, a decryption key may be acquired from the AITdelivered after starting the broadcast program. Alternatively, in theprocess at S20007, the decryption key may be acquired together with inacquiring the broadcast cooperative app (interpolation control) from theservice provider server 400. In other words, the decryption key may bein a state capable of being acquired immediately before the broadcaststart time of the broadcast program or after starting the broadcast.This can avoid such disadvantage that the content of the broadcastprogram is analogized from the additional data acquired before thebroadcast start time.

Next, a description is given of an outline of an example different fromthe above of an operation for displaying the video information of thebroadcast program at the frame rate of 120 Hz created by the broadcaststation on the video display unit 173 in the broadcast receiving device100 i in the broadcast receiving device 100 i in the embodiment withreference to FIG. 23A and FIG. 23B.

FIG. 23A is a conceptual diagram illustrating an example different fromthe above of an outline of the signal processing (on the broadcaststation side) in the communication system including the broadcastreceiving device 100 i in the embodiment.

A video information 821 which is the video information of the broadcastprogram created at the frame rate of 120 Hz by the broadcast stationincludes video frames F00, F01, F02, F03, F04, F05, and thosesubsequent. Needless to say, the video information 821 has 120 videoframes per second. The broadcast station does not subject the videoinformation 821 as itself to encoding or the like, but first,alternately extracts 60 video frames from 120 video frames per second tocreate video information 822 of the frame rate of 60 Hz. The videoinformation 822 includes video frames F00, F02, F04, and thosesubsequent. The broadcast station subjects the created video information822 of the frame rate of 60 Hz to the processing such as encoding,superimposition with respect to various pieces of information, andmodulation to be sent out from the radio tower 300 t. Note that thebroadcast wave sent out from the radio tower 300 t may be also receivedby and displayed on the older television not corresponding to the videoinformation of the frame rate of 120 Hz.

On the other hand, the video frames F01, F03, F05, and those subsequentare converted by an arithmetic processing using the video frames F00,F02, F04, and those subsequent or the like into differential data D01,D03, D05 and those subsequent (differential data 824), and furtherpackaged together with the time information. Further, the packaged datais sent from the broadcast station server 300 to the service providerserver 400 and stored in moving picture content storage area 4011 of thestorage unit 410. In a case where the packaged data has accompanyinginformation, the accompanying information is stored in the metadatastorage area 4012.

Note that the conversion into the differential data 824 by thearithmetic processing may be, for example, based on a simple datadifference from the last previous frame (D01=F01−F00), or may be basedon a data difference from an average between the last previous and firstsubsequent frames (D01=F01−(F00+F02)/2). There may be used a differenceor the like between motion prediction information calculated from thelast previous and first subsequent frames and a motion vector valuecalculated by an arithmetic operation using the last previous frame. Inother words, the conversion into the differential data 824 by thearithmetic processing may be made by use of known technology.

FIG. 23B is a conceptual diagram illustrating an example different fromthe above of an outline of the signal processing (on the broadcastreceiving device side) in the communication system including thebroadcast receiving device 100 i in the embodiment.

The broadcast receiving device 100 i subjects the broadcast wavereceived via the antenna 100 a to a channel selection/demodulationprocess in the tuner/demodulation unit 131 to output video information831 of the frame rate of 60 Hz from the first video decoding unit 133.Further, the video information 831 is input to the videointerpolation/superimposition unit 171 i. On the other hand,differential data 832 obtained by expanding the packaged data which isacquired from the service provider server 400 via the LAN communicationunit 121 is also input to the video interpolation/superimposition unit171 i.

The video interpolation/superimposition unit 171 i first subjects dataof each video frame of the video information 831 and the differentialdata 832 to the arithmetic processing on the basis of the control by theinterpolation signal processing unit 1102 i to perform the firstinterpolation signal processing 834 for reproducing the videoinformation 834. Note that the arithmetic processing in the firstinterpolation signal processing 834 may be an inverse operation of thearithmetic processing for performing the conversion to the differentialdata described in FIG. 23A. For example, in the case where thearithmetic processing in performing the conversion to the differentialdata is based on the data difference from the average between the lastprevious and first subsequent frames (D01=F01−(F00+F02)/2), thearithmetic operation “F01=D01+(F00+F02)/2” may be performed.

In addition, the video interpolation/superimposition unit 171 i furtherrefers to PCR information concerning the video information 831, timeinformation concerning video information 834, system clock informationof the broadcast receiving device 100 i, and the like on the basis ofthe control by the interpolation signal processing unit 1102 i whileperforming second interpolation signal processing 835 of insertingrespective video frames of the video information 834 between respectivevideo frames of the video information 831. For example, the video frameF01 of the video information 834 is inserted between the video framesF00 and F02 of the video information 831 and the video frame F03 of thevideo information 834 is inserted between the video frames F02 and F04of the video information 831 on the basis of the PCR information, thetime information and the like. As a result, video information 836 of theframe rate of 120 Hz is created. The video information 836 is furtherappropriately subjected to the signal processing by the videointerpolation/superimposition unit 171 i and provided to the user by thevideo display unit 173.

According to the signal processing in the communication system describedabove, the compatibility with the older television is maintained whilethe easy interpolation signal processing can reproduce the videoinformation of the frame rate of 120 Hz, and additionally can performvideo displaying with no brightness feeling deterioration, screenflicker and big noise occurring in the broadcast receiving device 100 iin the present invention.

Further, according to the signal processing in the communication systemdescribed above, the packaged data obtained by packaging thedifferential data 824 may have data capacity significantly reduced ascompared with the additional data obtained by packaging the videoinformation 803 (see FIG. 21A). In other words, the packaged dataobtained by packaging the differential data 824 may be delivered by wayof the broadcast wave to the broadcast receiving device 100 i.

FIG. 24 is an operational sequence diagram illustrating the operation ofthe broadcast receiving device 100 i in a case where the packaged dataobtained by packaging the differential data 824 is delivered by way ofthe broadcast wave.

After the same processes as at S20001 to S20008 in FIG. 22 areperformed, the broadcast cooperative app (interpolation control) run atS20008 acquires the additional data separated and output by the firstseparation unit 132 (S20110). Further, the broadcast cooperative app(interpolation control) expands the acquired additional data (packageddata), and further outputs the expanded differential data 832 to thevideo interpolation/superimposition unit 171 i.

The video information 831 of the broadcast program output from the firstvideo decoding unit 133 is also input to the videointerpolation/superimposition unit 171 i (S20111). The videointerpolation/superimposition unit 171 i performs first interpolationsignal processing 833 and the second interpolation signal processing 835on the basis of the control by the interpolation signal processing unit1102 i (S20112).

Note that the first interpolation signal processing 833 and the secondinterpolation signal processing 835 are repeated until an event occurssuch as end of the broadcast program, change of the channel, andpower-off of the broadcast receiving device 100 i (S20113). When theabove event or the like occurs, the broadcast cooperative app(interpolation control) ends its operation (S20015).

The above processes allow providing the higher-value added broadcastreceiving device capable of displaying the video information withreduced afterimage on the communication system in which thecompatibility with the older product is maintained also in the case ofthe broadcast program involving a strenuous motion such as sports relaybroadcasting.

Note that any of the above descriptions describes an example of the casewhere the video information 120 Hz can be displayed through theinterpolation signal processing made on the video information of 60 Hzreceived by the broadcast wave and the additional data acquired from theserver device. However, the present invention is not limited to theabove example, and may be applied to a case where the video informationof 240 Hz is displayed through the interpolation signal processing madeon the video information of 60 Hz received by way or the broadcast waveand the additional data acquired from the server device, a case wherethe video information of 240 Hz is displayed through the interpolationsignal processing made on the video information of 120 Hz received byway or the broadcast wave and the additional data acquired from theserver device, and the like. Moreover, it may be applied to a case wherethe video information of 100 Hz or 200 Hz is displayed through theinterpolation signal processing made on the video information of 50 Hzreceived by way or the broadcast wave and the additional data acquiredfrom the server device, a case where the video information of 200 Hz isdisplayed through the interpolation signal processing made on the videoinformation of 100 Hz received by way or the broadcast wave and theadditional data acquired from the server device, and the like.Additionally, the above description concerning 60 Hz may involvesubstantially 59.94 Hz (1/1.001 of 60 Hz) or the like. Similarly, theabove description concerning 120 Hz or 240 Hz may involve substantially119.88 Hz or 239.76 Hz.

Moreover, the additional data is not limited to the differential datafor the purpose of improving the frame rate as described above, and maybe the differential data for the purpose of improving the quantizationbit rate or the differential data for the purpose of improving theresolution. In this case, the video interpolation/superimposition unit171 i may perform the above respective processes for improving thepicture quality on the basis of the control by the interpolation signalprocessing unit 1102 i.

FIG. 25A is a conceptual diagram illustrating an example different fromthe above of an outline of the signal processing (on the broadcaststation side) in the communication system including the broadcastreceiving device 100 i in the embodiment. In addition, FIG. 25B is aconceptual diagram illustrating an example different from the above ofan outline of the signal processing (on the broadcast receiving deviceside) in the communication system including the broadcast receivingdevice 100 i in the embodiment.

For example, as shown in FIG. 25A, the broadcast station creates thevideo information 841 at the quantization bit rate of 12 bit for aluminance signal and color-difference signal (Y/Pb/Pr or Y/Cb/Cr andG/B/R may be used), and further higher 8 bits data of each of theluminance signal and the color-difference signal is extracted to createvideo information 842. The created video information 842 is subjected tothe processing such as encoding, superimposition with respect to variouspieces of information, and modulation to be sent out from the radiotower 300 t. On the other hand, lower 4 bits data of each of theluminance signal and color-difference signal is packaged with the timeinformation to be made into differential data 844. In addition, thedifferential data 844 may be further subjected to a lossless compressionprocess.

The broadcast receiving device 100 i, as shown in FIG. 25B, subjectsvideo information 851 output from the first video decoding unit 133 anddifferential data 852 acquired via the LAN communication unit 121 tointerpolation signal processing 855 to allow the high-definition videoinformation 856 with the quantization bit rate being improved to bedisplayed on the communication system in which the compatibility withthe older product is maintained. In other words, the higher-value addedbroadcast receiving device can be provided.

Moreover, the broadcast station creates the video information 841 at thequantization bit rate of 16 bit for the luminance signal andcolor-difference signal, and further higher 8 bits data of each of theluminance signal and the color-difference signal is extracted to createvideo information 842. On the other hand, differential data 844 aobtained by packaging lower 8 bits data of each of the luminance signaland the color-difference signal with the time information, anddifferential data 844 b obtained by packaging only higher 4 bits oflower 8 bits of each of the luminance signal and the color-differencesignal (i.e., 9th to 12th significant bit of totally 16 bits data) withthe time information may be created.

By doing so, the broadcast receiving device 100 i can control, dependingon the network traffic congestion between the broadcast receiving device100 i and the service provider server 400, so as to request and acquirethe differential data 844 a if the traffic is free, and request andacquire the differential data 844 b if congested.

FIG. 26A is a conceptual diagram illustrating an example different fromthe above of an outline of the signal processing (on the broadcaststation side) in the communication system including the broadcastreceiving device 100 i in the embodiment. In addition, FIG. 26B is aconceptual diagram illustrating an example different from the above ofan outline of the signal processing (on the broadcast receiving deviceside) in the communication system including the broadcast receivingdevice 100 i in the embodiment.

For example, as shown in FIG. 26A, the broadcast station creates videoinformation 861 in a format of 3840×2160 dots, the number of pixels foreach frame, and further extracts pixel data at a ratio one per fourpixels for each frame video of the video information 861 to create videoinformation 862 in a format of 1920×1080 dots, the number of pixels. Thecreated video information 862 is subjected to the processing such asencoding, superimposition with respect to various pieces of information,and modulation to be sent out from the radio tower 300 t. On the otherhand, the remaining three pixels of four pixels not extracted by thevideo information 862 is packaged with the time information to be madeinto differential data 864. Additionally, the differential data 864 maybe further appropriately subjected to a process such as compression andencoding to reduce the data volume.

The broadcast receiving device 100 i, as shown in FIG. 26B, subjectsvideo information 871 output from the first video decoding unit 133 anddifferential data 872 acquired via the LAN communication unit 121 tointerpolation signal processing 875 to allow the high-definition videoinformation 876 with the resolution being improved to be displayed onthe communication system in which the compatibility with the olderproduct is maintained. In other words, the higher-value added broadcastreceiving device can be provided.

Embodiment 7

Hereinafter, a description is given of Embodiment 7 in the presentinvention. Note that the configurations and effects in the embodimentare the same as in Embodiment 6 unless otherwise specified. In thefollowing description, differences between the embodiment and Embodiment6 are mainly explained, and a description of the common points isomitted as much as possible in order to avoid the duplicateddescription.

In the broadcast receiving device 100 i in the embodiment, theinterpolation signal processing service for the purpose of improving theframe rate, improving the quantization bit rate, improving theresolution and the like described in Embodiment 6 may be performeddepending on a billing condition. In other words, a description is givenof an example of the broadcast receiving device where a bill-chargeduser can enjoy a higher-quality picture video information even if whichis of an identical broadcast program than those a free-charge user canview.

FIG. 27 is a sequence diagram illustrating the operation of thebroadcast receiving device 100 i in the embodiment. The sequence diagramillustrates an example of a case where the signal processing (on thebroadcast receiving device side) described in FIG. 21B is performeddepending on the billing condition.

After the same processes as at S20001 to S20008 in FIG. 22 areperformed, the broadcast cooperative app (interpolation control) run atS20008, first, confirms with the user whether or not the broadcastprogram being displayed is to be subjected to high-quality picturedisplaying (S20201). The process at S20201 may be such that ahigh-quality picture display confirmation screen 173 f as shown in FIG.28, for example may be displayed on the video display unit 173, and theuse may be made to select “Yes” or “No” in a confirmation message 173 f1 through operating the operation terminal. In a case where the userselects “No” in the process at S20201, the broadcast cooperative app(interpolation control) ends the operation (S20015). In this case, thevideo information output from the first video decoding unit 133 is notsubjected to the interpolation signal processing, that is, the user mayview the broadcast program with a usual quality picture.

On the other hand, in a case where the user selects “Yes” in the processat S20201, then a billing condition confirming process is performed(S20210). Note that, in the embodiment, the broadcast receiving device100 i and the portable information terminal 700 may be already in astate where the cooperative operation is enabled. Alternatively, theauthentication process may have been already completed between thebroadcast receiving device 100 i and the portable information terminal700.

The billing condition confirming process at S20210 may adopt a knownmethod, but the following method may be adopted in the embodiment.First, the broadcast cooperative app (interpolation control) controlsthe terminal cooperation control unit 191 to send a request to confirmthe billing condition via the LAN communication unit 121 to the portableinformation terminal 700 (S20211). The portable information terminal 700having received the request to confirm the billing condition refers tothe authentication information storage area 7012 to confirm whether ornot a billing past record exists with respect to a predetermined serviceprovider server 400. In a case where the billing past record does notexist, the processes at S20212 to S20213 are not performed, and abilling condition confirmation result (NG) is sent via the LANcommunication unit 721 to the broadcast receiving device 100 i (S20214).In a case where the billing past record exists, the portable informationterminal 700 confirms the billing condition with the service providerserver 400 in order to confirm whether or not the billing past record isstill valid (S20212). The portable information terminal 700 receives thebilling information from the service provider server 400 (S20213), andfurther sends the billing condition confirmation result (OK or NG) viathe LAN communication unit 721 to the broadcast receiving device 100 i(S20214).

Next, the broadcast cooperative app (interpolation control) of thebroadcast receiving device 100 i confirms the billing conditionconfirmation result (OK or NG) received via the LAN communication unit121 from the portable information terminal 700 (S20221). In a case wherethe billing condition confirmation result is OK, then, the sameprocesses as at S20009 to S20014 in FIG. 22 are performed, and the useris provided by way of the video display unit 173 with the videoinformation of the broadcast program made to have the higher-qualitypicture through the interpolation signal processing than those thefree-charge user can view. In a case where the billing conditionconfirmation result is NG, the billing process is performed (S20230).The user may be again made to select whether or not the billing ischarged before the process at S20230.

The billing process at S20230 may adopt a known method, but thefollowing method may be adopted in the embodiment. First, the broadcastcooperative app (interpolation control) controls the terminalcooperation control unit 191 to send a billing process request via theLAN communication unit 121 to the portable information terminal 700(S20231). The portable information terminal 700 having received thebilling process request displays a login screen not shown in the figureon the display unit 741 (S20232). If the user operates the operationunit 730 to input user information (user identification information,password, credit card number, etc.) to the login screen (S20233), theportable information terminal 700 sends the user information togetherwith the identification information of the broadcast receiving device100 i which is already stored in the authentication information storagearea 7012 via the LAN communication unit 721 to the service providerserver 400 (S20234). The service provider server 400 appropriatelyperforms user authentication depending on a confirmation result of thesent user information and sends an authentication result to the portableinformation terminal 700 (S20235). Further, the portable informationterminal 700 sends completion of the billing process through theprocesses at S20232 to S20235 to the broadcast receiving device 100 i(S20236).

If the billing process is completed at S20230, then, the same processesas at S20009 to S20014 in FIG. 22 are performed, and the user isprovided by way of the video display unit 173 with the video informationof the broadcast program made to have the higher-quality picture throughthe interpolation signal processing than those the free-charge user canview.

Performing the above processes allows providing the higher-value addedbroadcast receiving device capable of performing, depending on a billingcondition, the interpolation signal processing service for the purposeof improving the frame rate, improving the quantization bit rate,improving the resolution and the like described in Embodiment 6.

In addition, the above process performing the interpolation signalprocessing service depending on the billing condition may be alsoapplied to the case where the additional data is delivered by way of thebroadcast wave as described in FIG. 24. In this case, the processsimilar to the sequence diagram in FIG. 27 is performed, and the sameprocessed as at S20110 to S20113 in FIG. 24 may be performed in place ofthe steps designated by “same processes as at S20009 to S20014 in FIG.22” in FIG. 27.

However, in the case where the additional data is delivered by way ofthe broadcast wave, the broadcast receiving device 100 i can access theadditional data whether or not the billing is charged. For this reason,the additional data may be preferably delivered by way of the broadcastwave in a state of being encrypted. Moreover, in this case, with respectto the bill-charged user, the service provider server 400 may send thedecryption key which can be used in the broadcast receiving device 100 itogether with the authentication result to the portable informationterminal 700 in the process at S20235, and further, the portableinformation terminal 700 may send the decryption key together with thebilling completion information to the broadcast receiving device 100 iin the process at S20236. Furthermore, the broadcast receiving device100 i may use the decryption key to decrypt an encryption processperformed on the additional data so as to perform the interpolationsignal processing.

Note that the billing condition confirming process and billing processdescribed above are absolutely examples, and may be performed by adifferent method, causing no problem. Moreover, needless to say, thebilling condition confirming process and the billing process may beperformed not via the portable information terminal 700 unlike theabove, but by the broadcast receiving device 100 i directlycommunicating with the service provider server 400.

Further, in place of the billing process, a member registration processmay be performed on a predetermined site or the like. In other words,the member registration on a predetermined site may allow theinterpolation signal processing service for the purpose of improving theframe rate, improving the quantization bit rate, improving theresolution and the like to be permitted to be used for free of charge.

Hereinabove, the examples of the illustrative embodiments in the presentinvention are described using Embodiments 1 to 7, needless to say, theconfigurations for achieving the technology of the present invention innot limited to the above embodiments and various modifications may beconsidered. For example, a part of a configuration of an embodiment maybe replaced with a configuration of another embodiment, and aconfiguration of an embodiment may be added to a configuration ofanother embodiment. These all belong to the scope of the presentinvention. Moreover, the numerals, messages and the like appearing inthe explanation and in the figures are absolutely examples, anddifferent one may be used without impairing the effects of the presentinvention.

A part or all of the above described functions or the like in thepresent invention may be implemented by, for example, hardware bydesigning using an integrated circuit. In addition, the above functionsmay be implemented by software by a microprocessor unit or the likeinterpreting and executing an operation program which implements eachfunction or the like. The hardware and the software may be used incombination.

Note that the software controlling the broadcast receiving device 100may be in a state of being stored in advance in the ROM 103 and/or thestorage unit 110 or the like in the broadcast receiving device 100 atthe time of product shipment. The software may be those acquired fromother application servers 500 or the like over the Internet 200 via theLAN communication unit 121 after product shipment. Moreover, thesoftware stored in the memory card, the optical disc or the like may beacquired via the expansion interface unit 124 and the like. Similarly,the software controlling the portable information terminal 700 may be ina state of being stored in advance in the ROM 703 and/or the storageunit 710 or the like in the portable information terminal 700 at thetime of product shipment. The software may be those acquired from otherapplication servers 500 or the like over the Internet 200 via the LANcommunication unit 721 or the mobile telephone network communicationunit 722 after product shipment. Moreover, the software stored in thememory card, the optical disc or the like may be acquired via theexpansion interface unit 724 and the like.

In addition, control lines or information lines shown in the figures arethose considered to be required for the purpose of explanation, and allthe control lines or information lines of the product may notnecessarily shown. Actually, almost all the components may be consideredto be connected with each other.

The above description is given of the embodiments, but the presentinvention is not limited thereto, and it is appreciated by those skilledin the art that various changes and modifications may be made in thescope of the spirit of the present invention and the accompanyingclaims.

REFERENCE SIGNS LIST

-   100, 1001 broadcast receiving device-   100 a antenna-   101 main control unit-   102 system bus-   103 ROM-   104 RAM-   110 storage unit-   121 LAN communication unit-   124 expansion interface unit-   125 digital interface unit-   131 tuner/demodulation unit-   132 first separation unit-   133 first video decoding unit-   134 first audio decoding unit-   135 first caption decoding unit-   141 data broadcast reception processing unit-   142 data broadcast engine-   151 streaming reception processing unit-   152 second separation unit-   153 second video decoding unit-   154 second audio decoding unit-   155 second caption decoding unit-   161 application control unit-   162 application engine-   171 video superimposition unit-   171 i video interpolation/superimposition unit-   172 audio selection unit-   173 video display unit-   174 speaker-   175 video output unit-   176 audio output unit-   181 presentation synchronization control unit-   191 terminal cooperation control unit-   200 Internet-   210 router device-   300 t radio tower-   300 broadcast station server-   301 main control unit-   302 system bus-   304 RAM-   310 storage unit-   321 LAN communication unit-   400 service provider server-   401 main control unit-   402 system bus-   404 RAM-   410 storage unit-   421 LAN communication unit-   500 other application server-   600 mobile telephone communication server-   600 b base station-   700 portable information terminal-   701 main control unit-   702 system bus-   703 ROM-   704 RAM-   710 storage unit-   720 communication processing unit-   721 LAN communication unit-   722 mobile telephone network communication unit-   723 NFC communication unit-   724 expansion interface unit-   730 operation unit-   740 image processing unit-   741 display unit-   742 image signal processing unit-   743 first image input unit-   744 second image input unit-   750 audio processing unit-   751 audio output unit-   752 audio signal processing unit-   753 audio input unit-   760 sensor unit-   761 GPS reception unit-   762 gyro sensor-   763 geomagnetic sensor-   764 acceleration sensor-   765 illuminance sensor-   766 proximity sensor

We claim:
 1. A broadcast receiving apparatus receiving a digitalbroadcast service which is capable of executing an application incooperation with a broadcast program, comprising: a receiver configuredto receive a broadcast wave of the digital broadcast service; aseparator configured to separate at least video information of abroadcast program and application-related information from the receivedbroadcast wave; a broadcast video decoder configured to decode the videoinformation of the broadcast program; an application controllerconfigured to acquire a predetermined application on basis of locationinformation acquired by referring to the application-relatedinformation; an application processor configured to execute the acquiredpredetermined application to acquire additional data from apredetermined server via a network; a video processor configured toperform a high-quality video conversion processing for making video ofthe broadcast program decoded by the broadcast video decoder to havehigher quality, using the additional data acquired by the applicationprocessor; and a display capable of displaying the video subjected tothe high-quality video conversion processing, wherein the videoinformation of the broadcast program and the additional data are eachgenerated from same video information before broadcast, the applicationcontroller acquires the predetermined application in cooperation withthe broadcast program when determining, based on information containedin the application-related information, that the broadcast receivingapparatus can execute the high-quality video conversion processing usingthe additional data, the application processor can acquire theadditional data by executing the acquired predetermined application,before broadcast start time of the broadcast program, after start of thebroadcast program, the video processor performs the high-quality videoconversion processing using at least part of the additional dataacquired before the broadcast start time of the broadcast program. 2.The broadcast receiving apparatus according to claim 1, wherein the atleast part of the additional data acquired before the broadcast starttime of the broadcast program is encrypted at least before the start ofthe broadcast program.
 3. The broadcast receiving apparatus according toclaim 1, wherein the application-related information includes a controlcode relating to start of an application, and when the control codedefines automatic start, the application controller automaticallyacquires the predetermined application.
 4. The broadcast receivingapparatus according to claim 1, wherein the application-relatedinformation includes an application profile indicating a function of thebroadcast receiving apparatus required by an application, and theapplication controller acquires the predetermined application whendetermining with reference to the application profile that the broadcastreceiving apparatus can execute an application.
 5. The broadcastreceiving apparatus according to claim 1, further comprising: a billingprocessor configured to confirm whether or not a user of the broadcastreceiving apparatus has paid a charge for use of service to apredetermined service provider; wherein in a case where the billingprocessor confirms that the user of the broadcast receiving apparatushas paid the charge for use of service to the predetermined serviceprovider, the video processor performs the high-quality video conversionprocessing on the broadcast program decoded by the broadcast videodecoder using the additional data acquired by the application processor.6. The broadcast receiving apparatus according to claim 1, wherein theadditional data is differential data for improving a frame rate of thebroadcast program decoded by the broadcast video decoder, and the videoprocessor converts the broadcast program decoded by the broadcast videodecoder into a high-quality video of a higher frame rate.
 7. Thebroadcast receiving apparatus according to claim 1, wherein theadditional data is differential data for improving a quantization bitrate of the broadcast program decoded by the broadcast video decoder,and the video processor converts the broadcast program decoded by thebroadcast video decoder into a high-quality video of a higherquantization bit rate.
 8. The broadcast receiving apparatus according toclaim 1, wherein the additional data is differential data for improvinga resolution of the broadcast program decoded by the broadcast videodecoder, and the video processor converts the broadcast program decodedby the broadcast video decoder into a high-quality video of a higherresolution.